00000001:02000400:2.0F:1787134440.246790:0:2961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_hostid 00000001:02000400:2.0:1787134464.043656:0:3183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787134465.751241:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1051 MB/s 00000001:01000000:3.0F:1787134466.001742:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1099 MB/s 00000001:01000000:2.0:1787134466.251292:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5327 MB/s 00000020:02000000:3.0:1787134466.983771:0:3275:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.57_11_g9d7c9d8 00000400:02000000:1.0F:1787134468.173152:0:3290:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.136@tcp [8/256/0/180] 00008000:02000000:3.0:1787134472.299640:0:3440:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1787134533.079959:0:5242:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787134544.059499:0:5817:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787134544.059509:0:5817:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787134544.059620:0:5817:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000090e5dcb7 00000080:02000400:1.0:1787134544.059633:0:5817:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787134544.071909:0:5817:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787134544.071924:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787134544.074525:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000267fbb0f) 00000020:00000080:2.0:1787134544.074560:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787134544.162360:0:5817:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787134544.164980:0:5817:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787134544.235991:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787134544.236138:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787134544.236183:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787134544.236241:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787134544.236269:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787134544.238935:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787134544.238951:0:5817:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787134544.238968:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae905aac 00000020:01000004:2.0:1787134544.238978:0:5817:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787134544.238983:0:5817:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787134544.238989:0:5817:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000090e5dcb7 from MGS 00000020:01000004:2.0:1787134544.238995:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787134544.239008:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000dc66ef4c) 00000020:00000080:2.0:1787134544.239021:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787134544.239105:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000090e5dcb7 from MGS, refs=2 00080000:01000000:2.0:1787134544.239111:0:5817:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787134544.239117:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae905aba 00000100:00100000:2.0:1787134544.239292:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787134544.239425:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787134544.239432:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787134544.249295:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787134544.249313:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787134544.253971:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787134544.254311:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787134544.254319:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787134544.256233:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787134544.256247:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787134544.259646:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787134544.259661:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787134544.261075:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134544.261081:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134544.261083:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134544.261543:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134544.261547:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134544.261549:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134544.262199:0:5817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787134544.274241:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787134544.512218:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2083 MB/s 00000001:01000000:2.0:1787134544.768051:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2729 MB/s 00000001:01000000:2.0:1787134545.018130:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 419 MB/s 00000001:01000000:0.0:1787134545.268214:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 419 MB/s 00010000:00010000:1.0:1787134545.280467:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787134545.297821:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787134545.332277:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787134545.332295:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787134545.332297:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787134545.341685:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787134545.341819:0:5817:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787134545.341907:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787134545.342603:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787134545.342639:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787134545.349122:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787134545.349345:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787134545.349352:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787134545.354721:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787134545.354735:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787134545.355077:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787134545.355083:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1787134545.371505:0:5831:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787134545.372263:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787134545.372290:0:5817:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.136@tcp' 00000020:01000004:1.0:1787134545.372292:0:5817:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787134545.372346:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.136@tcp (typ=mgc) 00000020:00000080:1.0:1787134545.372367:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.136@tcp (00000000d560fcc0) 00000020:00000080:1.0:1787134545.373712:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787134545.373878:0:5817:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000c7cd4ef2@MGC192.168.202.136@tcp: add connection 192.168.202.136@tcp at head 00010000:00010000:1.0:1787134545.374031:0:5817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.136@tcp-0 is initialized 00000040:01000000:1.0:1787134545.374036:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787134545.374601:0:5832:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787134545.374665:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.136@tcp (uuid e5b817d2-f0c2-441a-949c-994c1ff95f2c) 00000020:00000080:1.0:1787134545.374681:0:5817:0:(genops.c:1406:class_connect()) connect: client e5b817d2-f0c2-441a-949c-994c1ff95f2c, cookie 0x69932dacae905ac8 00000100:00080000:1.0:1787134545.374695:0:5817:0:(import.c:510:import_select_connection()) MGC192.168.202.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787134545.374699:0:5817:0:(import.c:624:import_select_connection()) MGC192.168.202.136@tcp: import 00000000c7cd4ef2 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787134545.374734:0:5817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003fb2073a x1873946311917696/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787134545.374863:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fb2073a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3306:1873946311917696:0@lo:250: 00000100:00100000:3.0:1787134545.374932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134545.375030:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311917696 00000100:00100000:2.0:1787134545.375050:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311917696 00000100:00100000:2.0:1787134545.375084:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134545.375090:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ebb99f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1873946311917696:12345-0@lo:250: 00010000:00080000:2.0:1787134545.375115:0:5828:0:(ldlm_lib.c:1449:target_handle_connect()) MGS: connection from e5b817d2-f0c2-441a-949c-994c1ff95f2c@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:2.0:1787134545.375135:0:5828:0:(genops.c:1406:class_connect()) connect: client e5b817d2-f0c2-441a-949c-994c1ff95f2c, cookie 0x69932dacae905acf 00000100:00080000:2.0:1787134545.375276:0:5828:0:(import.c:65:import_set_state_nolock()) 00000000ce399f44 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787134545.376946:0:5817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e5b817d2-f0c2-441a-949c-994c1ff95f2c->MGS 00000020:01000004:1.0:1787134545.376975:0:5817:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787134545.376981:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787134545.376994:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000169de139) 00000020:00000080:1.0:1787134545.377009:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787134545.391888:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ebb99f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:3306:x1873946311917696:12345-0@lo:250: Request processed in 16785us (16945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134545.391908:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787134545.393538:0:3306:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787134545.393554:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.136@tcp: connect to target with instance 0 00000100:00080000:3.0:1787134545.393562:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787134545.393566:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787134545.393570:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000c7cd4ef2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787134545.393573:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787134545.393584:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787134545.393592:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fb2073a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3306:1873946311917696:0@lo:250: 00000100:00100000:1.0:1787134545.402077:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787134545.402322:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787134545.402330:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787134545.403223:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787134545.403234:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787134545.404024:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787134545.404032:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787134545.406321:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787134545.406528:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787134545.406534:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787134545.409279:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787134545.409302:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787134545.486764:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787134545.486993:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787134545.487000:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787134545.491630:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787134545.491656:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787134545.492383:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787134545.492570:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787134545.492576:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787134545.502337:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787134545.502360:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787134545.512743:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134545.512952:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787134545.512959:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787134545.513520:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787134545.513527:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787134545.514726:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134545.514943:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787134545.514949:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787134545.518907:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787134545.518925:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787134545.615968:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787134545.616230:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787134545.616237:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787134545.618779:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787134545.618797:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787134545.620693:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787134545.620782:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787134545.626967:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787134545.627004:0:5817:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787134545.627010:0:5817:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787134545.627227:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787134545.627277:0:5817:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.136@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787134545.627350:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787134545.627352:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787134545.627354:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787134545.627355:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787134545.627426:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787134545.627429:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787134545.627430:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787134545.627431:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787134545.627433:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787134545.627434:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787134545.627435:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787134545.627436:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787134545.627439:0:5817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787134545.627442:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787134545.627443:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787134545.627444:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787134545.627445:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787134545.627446:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787134545.627448:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787134545.627448:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787134545.627449:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787134545.627451:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787134545.627451:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787134545.627452:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787134545.627453:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787134545.627494:0:5817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787134545.627513:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007daa4cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311917824:0@lo:253: 00000100:00100000:3.0:1787134545.627666:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134545.627800:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f6d0ccbe going to sleep for 11 seconds 00000100:00100000:1.0:1787134545.630472:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311917824 00000100:00100000:1.0:1787134545.630490:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311917824 00000100:00100000:1.0:1787134545.630655:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787134545.630665:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a6dec883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:5817:x1873946311917824:12345-0@lo:253: 20000000:01000000:1.0:1787134545.630741:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787134545.630749:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787134545.633539:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787134545.633684:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787134545.634006:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787134545.635800:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787134545.636798:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787134545.636804:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787134545.636810:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787134545.636813:0:5830:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787134545.636827:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787134545.637053:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134545.638527:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787134545.638551:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787134545.638681:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787134545.638812:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787134545.638852:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787134545.638964:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787134545.638972:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787134545.639019:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787134545.639028:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787134545.639089:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787134545.639098:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787134545.639128:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787134545.639196:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787134545.639227:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787134545.639232:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787134545.639244:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134545.643969:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787134545.644006:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787134545.644090:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787134545.644131:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787134545.644213:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787134545.644231:0:5830:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787134545.647206:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787134545.647230:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787134545.647308:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787134545.647372:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787134545.647407:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787134545.647421:0:5830:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787134545.647550:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787134545.647574:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787134545.647609:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787134545.647645:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787134545.647844:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787134545.647890:0:5830:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787134545.647898:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787134545.648878:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787134545.649185:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787134545.649210:0:5830:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.136@tcp for mdt 20000000:01000000:1.0:1787134545.649212:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:1.0:1787134545.649246:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787134545.649254:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787134545.649496:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787134545.649505:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:1.0:1787134545.649550:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787134545.649626:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787134545.649666:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787134545.649704:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787134545.649919:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787134545.649922:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787134545.649926:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787134545.649937:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787134545.649939:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787134545.649967:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787134545.649969:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787134545.653084:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787134545.653655:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787134545.653723:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787134545.653772:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787134545.653785:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787134545.653788:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787134545.655519:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787134545.665979:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787134545.666060:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787134545.666377:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1787134545.666403:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787134545.666406:0:5830:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787134545.666413:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787134545.666421:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787134545.666428:0:5830:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787134545.666434:0:5830:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787134545.671642:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787134545.681340:0:5830:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787134545.709957:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787134545.710030:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787134545.711241:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787134545.711273:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787134545.711298:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711315:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711325:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711339:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711345:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711351:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711428:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6fd6f35 already unused, calling callback (00000000e500d2c7) 00010000:00010000:0.0:1787134545.711432:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711439:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711452:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711460:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134545.711465:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c6fd6f35/0x69932dacae905add lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787134545.711483:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787134546.068277:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a6dec883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:5817:x1873946311917824:12345-0@lo:253: Request processed in 437605us (440603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134546.068303:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787134546.068422:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007daa4cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311917824:0@lo:253: 10000000:01000000:0.0:1787134546.068440:0:5817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787134546.068443:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787134546.068445:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787134546.068452:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134546.068454:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787134546.068455:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134546.068456:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134546.068457:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787134546.068458:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787134546.068460:0:5817:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787134546.068461:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134546.068463:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787134546.068482:0:5817:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000090e5dcb7 from lustre-MDT0000 10000000:01000000:0.0:1787134546.068506:0:5817:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787134546.068509:0:5817:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787134546.068512:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98aa6aa4b380 10000000:01000000:0.0:1787134546.068516:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787134546.068523:0:5817:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98aa6aa4b380 from 1 10000000:01000000:0.0:1787134546.068526:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787134546.068569:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000c6fd6f35/0x69932dacae905ae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.068579:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000c6fd6f35/0x69932dacae905ae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.068587:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000c6fd6f35/0x69932dacae905ae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134546.068604:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311917952:0@lo:101: 00000100:00100000:0.0:1787134546.068637:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134546.068680:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eadf1327 going to sleep for 11 seconds 00000100:00100000:2.0:1787134546.068826:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311917952 00000100:00100000:2.0:1787134546.068833:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311917952 00000100:00100000:2.0:1787134546.068873:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787134546.068880:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e0079a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:5817:x1873946311917952:12345-0@lo:101: 00010000:00010000:2.0:1787134546.068892:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134546.068906:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e8c7146/0x69932dacae905aeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905ae4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.068927:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e8c7146/0x69932dacae905aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905ae4 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.068936:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e8c7146/0x69932dacae905aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905ae4 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.068944:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e8c7146, rc 0) 00000100:00100000:2.0:1787134546.068981:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e0079a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+6:5817:x1873946311917952:12345-0@lo:101: Request processed in 102us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134546.068986:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787134546.069154:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311917952:0@lo:101: 00010000:00010000:0.0:1787134546.069199:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000c6fd6f35/0x69932dacae905ae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.069208:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000c6fd6f35/0x69932dacae905ae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134546.069258:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918080:0@lo:501: 00000100:00100000:0.0:1787134546.069282:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134546.069298:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eadf1327 going to sleep for 11 seconds 00000100:00100000:1.0:1787134546.069354:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311918080 00000100:00100000:1.0:1787134546.069360:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311918080 00000100:00100000:1.0:1787134546.069389:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787134546.069395:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9398736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+6:5817:x1873946311918080:12345-0@lo:501: 00000100:00100000:1.0:1787134546.069640:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9398736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+6:5817:x1873946311918080:12345-0@lo:501: Request processed in 244us (356us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787134546.069647:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134546.069730:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918080:0@lo:501: 10000000:01000000:0.0:1787134546.069763:0:5817:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787134546.069783:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000c6fd6f35/0x69932dacae905ae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.069790:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000c6fd6f35/0x69932dacae905ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134546.069797:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98aa4da38000 10000000:01000000:0.0:1787134546.069801:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787134546.069805:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98aa4da38000 10000000:01000000:0.0:1787134546.069808:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787134546.069811:0:5817:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98aa4da38000 from 1 10000000:01000000:0.0:1787134546.069813:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787134546.069829:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000cf7d98fd/0x69932dacae905af2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.069835:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000cf7d98fd/0x69932dacae905af2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.069842:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000cf7d98fd/0x69932dacae905af2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134546.069852:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918208:0@lo:101: 00000100:00100000:0.0:1787134546.069884:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134546.069896:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eadf1327 going to sleep for 11 seconds 00000100:00100000:1.0:1787134546.070017:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311918208 00000100:00100000:1.0:1787134546.070021:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311918208 00000100:00100000:1.0:1787134546.070123:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787134546.070131:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074525155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+6:5817:x1873946311918208:12345-0@lo:101: 00010000:00010000:1.0:1787134546.070139:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134546.070152:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000679ff4a6/0x69932dacae905af9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905af2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.070191:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000679ff4a6/0x69932dacae905af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905af2 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.070198:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000679ff4a6/0x69932dacae905af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905af2 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.070205:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000679ff4a6, rc 0) 00000100:00100000:1.0:1787134546.070232:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074525155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+7:5817:x1873946311918208:12345-0@lo:101: Request processed in 103us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134546.070238:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134546.070312:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918208:0@lo:101: 00010000:00010000:0.0:1787134546.070322:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000cf7d98fd/0x69932dacae905af2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.070328:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000cf7d98fd/0x69932dacae905af2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134546.070339:0:5817:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787134546.070354:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000cf7d98fd/0x69932dacae905af2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.070360:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000cf7d98fd/0x69932dacae905af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134546.070365:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787134546.070369:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787134546.070373:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98aa4da38000 10000000:01000000:0.0:1787134546.070375:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787134546.070377:0:5817:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787134546.070379:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787134546.070392:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000b213d745/0x69932dacae905b00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.070399:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000b213d745/0x69932dacae905b00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.070404:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000b213d745/0x69932dacae905b00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134546.070422:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918336:0@lo:101: 00000100:00100000:0.0:1787134546.070446:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134546.070463:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eadf1327 going to sleep for 11 seconds 00000100:00100000:1.0:1787134546.070520:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311918336 00000100:00100000:1.0:1787134546.070525:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311918336 00000100:00100000:1.0:1787134546.070557:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787134546.070563:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000813d46a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+7:5817:x1873946311918336:12345-0@lo:101: 00010000:00010000:1.0:1787134546.070569:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134546.070575:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000212455bf/0x69932dacae905b07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905b00 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.070586:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000212455bf/0x69932dacae905b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905b00 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.070593:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000212455bf/0x69932dacae905b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b00 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.070598:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000212455bf, rc 0) 00000100:00100000:1.0:1787134546.070623:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000813d46a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+8:5817:x1873946311918336:12345-0@lo:101: Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134546.070629:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787134546.070695:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918336:0@lo:101: 00010000:00010000:0.0:1787134546.070774:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000b213d745/0x69932dacae905b00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.070782:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000b213d745/0x69932dacae905b00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134546.070818:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918464:0@lo:501: 00000100:00100000:0.0:1787134546.070841:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134546.070860:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eadf1327 going to sleep for 11 seconds 00000100:00100000:1.0:1787134546.070911:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311918464 00000100:00100000:1.0:1787134546.070915:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311918464 00000100:00100000:1.0:1787134546.070942:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787134546.070948:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d900295b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+8:5817:x1873946311918464:12345-0@lo:501: 00000100:00100000:1.0:1787134546.071219:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d900295b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:5817:x1873946311918464:12345-0@lo:501: Request processed in 271us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134546.071225:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787134546.071341:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918464:0@lo:501: 00000100:00100000:0.0:1787134546.071367:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918592:0@lo:503: 00000100:00100000:0.0:1787134546.071403:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134546.071427:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eadf1327 going to sleep for 11 seconds 00000100:00100000:1.0:1787134546.071569:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311918592 00000100:00100000:1.0:1787134546.071573:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311918592 00000100:00100000:1.0:1787134546.071601:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787134546.071607:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089705abc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:5817:x1873946311918592:12345-0@lo:503: 00000100:00100000:1.0:1787134546.071916:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089705abc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:5817:x1873946311918592:12345-0@lo:503: Request processed in 308us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134546.071929:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787134546.072102:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918592:0@lo:503: 00000100:00100000:2.0:1787134546.072793:0:5859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c038df97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5859:1873946311918720:0@lo:502: 00000100:00100000:2.0:1787134546.072838:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134546.072911:0:5859:0:(client.c:2702:ptlrpc_set_wait()) set 00000000541ab255 going to sleep for 11 seconds 00000100:00100000:0.0:1787134546.072952:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311918720 00000100:00100000:0.0:1787134546.072958:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311918720 00000100:00100000:0.0:1787134546.073100:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787134546.073108:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003afa454c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:5859:x1873946311918720:12345-0@lo:502: 00000100:00100000:0.0:1787134546.073384:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003afa454c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:5859:x1873946311918720:12345-0@lo:502: Request processed in 277us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134546.073399:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787134546.073498:0:5859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c038df97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5859:1873946311918720:0@lo:502: 00000020:01000000:3.0:1787134546.073525:0:5859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134546.073535:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134546.073537:0:5859:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787134546.073548:0:5859:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787134546.073551:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787134546.073568:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b6482d1a) 00000020:00000080:3.0:1787134546.073584:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787134546.073589:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787134546.073677:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787134546.073685:0:5859:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae905b15 00000020:00000080:3.0:1787134546.073984:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787134546.073989:0:5859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134546.073992:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134546.073993:0:5859:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787134546.073996:0:5859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134546.073999:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134546.074001:0:5859:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787134546.074004:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787134546.074009:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c0889923) 00000020:00000080:3.0:1787134546.074019:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787134546.074022:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787134546.074024:0:5859:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787134546.074137:0:5859:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787134546.074145:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787134546.074217:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000090e5dcb7 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787134546.074229:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000749fadd1) 00000020:00000080:3.0:1787134546.074237:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787134546.074287:0:5859:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787134546.074293:0:5859:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae905b2a 00000020:00000080:3.0:1787134546.074394:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787134546.074400:0:5859:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787134546.074406:0:5859:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x69932dacae905b31 00080000:01000000:3.0:1787134546.074410:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787134546.074413:0:5859:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae905b38 00080000:10000000:3.0:1787134546.075424:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787134546.075651:0:5859:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787134546.079798:0:5859:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787134546.187553:0:5859:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787134546.188598:0:5859:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787134546.191493:0:5859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787134546.192509:0:5859:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787134546.237857:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000079d89848) 00000020:00000080:2.0:1787134546.237879:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787134546.237956:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787134546.237964:0:5859:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae905b46 00000020:00000080:3.0:1787134546.243594:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787134546.249830:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00010000:00010000:1.0:1787134546.304435:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787134546.315623:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787134546.384455:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787134546.440881:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787134546.531194:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787134546.592651:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787134546.623258:0:5859:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x69932dacae905b4d 00000020:00000080:2.0:1787134546.623929:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787134546.623941:0:5859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787134546.623947:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134546.623950:0:5859:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787134546.623953:0:5859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787134546.623957:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134546.623959:0:5859:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787134546.623961:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787134546.623963:0:5859:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787134546.623965:0:5859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787134546.623967:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134546.623968:0:5859:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787134546.623970:0:5859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787134546.623974:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134546.623976:0:5859:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787134546.623979:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787134546.624015:0:5859:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787134546.624078:0:5859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050ee3e98 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5859:1873946311918848:0@lo:502: 00000100:00100000:2.0:1787134546.624268:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134546.624467:0:5859:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df9b48d5 going to sleep for 11 seconds 00000100:00100000:1.0:1787134546.630566:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311918848 00000100:00100000:1.0:1787134546.630583:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311918848 00000100:00100000:1.0:1787134546.630642:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787134546.630659:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000063fc4c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:5859:x1873946311918848:12345-0@lo:502: 00000100:00100000:1.0:1787134546.631049:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000063fc4c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:5859:x1873946311918848:12345-0@lo:502: Request processed in 391us (6893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134546.631056:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787134546.631368:0:5859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050ee3e98 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5859:1873946311918848:0@lo:502: 00000020:01000000:0.0:1787134546.631406:0:5859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134546.631413:0:5859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134546.631416:0:5859:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787134546.631420:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787134546.631643:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787134546.631671:0:5817:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787134546.631738:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000b213d745/0x69932dacae905b00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.631759:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000b213d745/0x69932dacae905b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134546.631767:0:5817:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98aa4da38000 from 1 10000000:01000000:1.0:1787134546.631770:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787134546.631802:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.631810:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.631818:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134546.631836:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918976:0@lo:101: 00000100:00100000:1.0:1787134546.631882:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134546.631927:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0ff137b going to sleep for 11 seconds 00000100:00100000:0.0:1787134546.632212:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311918976 00000100:00100000:0.0:1787134546.632219:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311918976 00000100:00100000:0.0:1787134546.632260:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787134546.632268:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000826277a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:5817:x1873946311918976:12345-0@lo:101: 00010000:00010000:0.0:1787134546.632279:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134546.632293:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905b54 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.632315:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905b54 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.632325:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b54 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.632333:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000378a2f93, rc 0) 00000100:00100000:0.0:1787134546.632377:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000826277a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:5817:x1873946311918976:12345-0@lo:101: Request processed in 110us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134546.632383:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787134546.632561:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311918976:0@lo:101: 00010000:00010000:1.0:1787134546.632575:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.632584:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134546.633223:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919104:0@lo:256: 00000100:00100000:1.0:1787134546.633266:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134546.633886:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0ff137b going to sleep for 11 seconds 00000100:00100000:2.0:1787134546.634446:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311919104 00000100:00100000:2.0:1787134546.634455:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311919104 00000100:00100000:2.0:1787134546.634537:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787134546.634546:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000061109f1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:5817:x1873946311919104:12345-0@lo:256: 20000000:01000000:2.0:1787134546.634568:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787134546.634574:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787134546.634686:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000061109f1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:5817:x1873946311919104:12345-0@lo:256: Request processed in 141us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134546.634715:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787134546.634803:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919104:0@lo:256: 10000000:01000000:1.0:1787134546.637096:0:5817:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787134546.637130:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.637145:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134546.637173:0:5817:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa4da38000 from 1 10000000:01000000:1.0:1787134546.637176:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787134546.637217:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.637225:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.637237:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134546.637271:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919232:0@lo:101: 00000100:00100000:1.0:1787134546.637337:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134546.640100:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0ff137b going to sleep for 11 seconds 00000100:00100000:0.0:1787134546.640263:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311919232 00000100:00100000:0.0:1787134546.640290:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311919232 00000100:00100000:0.0:1787134546.640337:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787134546.640346:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035df3cde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:5817:x1873946311919232:12345-0@lo:101: 00010000:00010000:0.0:1787134546.640373:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134546.640393:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905b62 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.640419:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905b62 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.640430:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b62 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.640439:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000391c7385, rc 0) 00000100:00100000:0.0:1787134546.640499:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035df3cde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:5817:x1873946311919232:12345-0@lo:101: Request processed in 155us (3161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134546.640505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787134546.640669:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919232:0@lo:101: 00010000:00010000:1.0:1787134546.640686:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.640694:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134546.640777:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919360:0@lo:501: 00000100:00100000:1.0:1787134546.640812:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134546.640837:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0ff137b going to sleep for 11 seconds 00000100:00100000:0.0:1787134546.640981:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311919360 00000100:00100000:0.0:1787134546.640986:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311919360 00000100:00100000:0.0:1787134546.641006:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787134546.641011:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ad700e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:5817:x1873946311919360:12345-0@lo:501: 00000100:00100000:0.0:1787134546.641964:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ad700e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:5817:x1873946311919360:12345-0@lo:501: Request processed in 950us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134546.641975:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787134546.642123:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919360:0@lo:501: 00000100:00100000:1.0:1787134546.642191:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919488:0@lo:503: 00000100:00100000:1.0:1787134546.642238:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134546.642270:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0ff137b going to sleep for 11 seconds 00000100:00100000:0.0:1787134546.642449:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311919488 00000100:00100000:0.0:1787134546.642456:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311919488 00000100:00100000:0.0:1787134546.642485:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787134546.642491:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000426e88e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:5817:x1873946311919488:12345-0@lo:503: 00000040:00080000:0.0:1787134546.642534:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787134546.642593:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000426e88e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:5817:x1873946311919488:12345-0@lo:503: Request processed in 101us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134546.642600:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787134546.643030:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919488:0@lo:503: 00000040:00080000:1.0:1787134546.646012:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787134546.646497:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787134546.646520:0:5817:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787134546.646542:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134546.646556:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134546.646610:0:5817:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787134546.646613:0:5817:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98aa4da38000 10000000:01000000:3.0:1787134546.646617:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98aa4da38000 10000000:01000000:3.0:1787134546.646621:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787134546.646629:0:5817:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa4da38000 from 1 10000000:01000000:3.0:1787134546.646632:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787134546.646675:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 000000003a4db5ae/0x69932dacae905b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134546.646685:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 000000003a4db5ae/0x69932dacae905b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134546.646771:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 000000003a4db5ae/0x69932dacae905b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134546.646814:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001effd9b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919616:0@lo:101: 00000100:00100000:3.0:1787134546.646884:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134546.646932:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 000000006e1db847 going to sleep for 11 seconds 00000100:00100000:0.0:1787134546.647027:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311919616 00000100:00100000:0.0:1787134546.647035:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311919616 00000100:00100000:0.0:1787134546.647084:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787134546.647092:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000dce4cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:5817:x1873946311919616:12345-0@lo:101: 00010000:00010000:0.0:1787134546.647107:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134546.647119:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000aae360d/0x69932dacae905b77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905b70 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.647143:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000aae360d/0x69932dacae905b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905b70 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.647153:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000aae360d/0x69932dacae905b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b70 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.647196:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000aae360d, rc 0) 00000100:00100000:0.0:1787134546.647243:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000dce4cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5817:x1873946311919616:12345-0@lo:101: Request processed in 152us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134546.647251:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787134546.647340:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001effd9b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919616:0@lo:101: 00010000:00010000:1.0:1787134546.647366:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 000000003a4db5ae/0x69932dacae905b70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.647376:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 000000003a4db5ae/0x69932dacae905b70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134546.647431:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919744:0@lo:501: 00000100:00100000:1.0:1787134546.647459:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134546.647487:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039c4d6b1 going to sleep for 11 seconds 00000100:00100000:0.0:1787134546.647583:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311919744 00000100:00100000:0.0:1787134546.647587:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311919744 00000100:00100000:0.0:1787134546.647616:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787134546.647623:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c470642c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5817:x1873946311919744:12345-0@lo:501: 00000100:00100000:0.0:1787134546.647897:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c470642c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5817:x1873946311919744:12345-0@lo:501: Request processed in 274us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134546.647904:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787134546.648148:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919744:0@lo:501: 00000100:00100000:1.0:1787134546.648208:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919872:0@lo:503: 00000100:00100000:1.0:1787134546.648246:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134546.648263:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039c4d6b1 going to sleep for 11 seconds 00000100:00100000:0.0:1787134546.648326:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311919872 00000100:00100000:0.0:1787134546.648336:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311919872 00000100:00100000:0.0:1787134546.648468:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787134546.648475:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ab068ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5817:x1873946311919872:12345-0@lo:503: 00000100:00100000:0.0:1787134546.649655:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ab068ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5817:x1873946311919872:12345-0@lo:503: Request processed in 1176us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134546.649667:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787134546.649850:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311919872:0@lo:503: 00000100:00100000:2.0:1787134546.650422:0:5864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002b340124 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5864:1873946311920000:0@lo:502: 00000100:00100000:2.0:1787134546.650565:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134546.650626:0:5864:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f6d0ccbe going to sleep for 11 seconds 00000100:00100000:1.0:1787134546.650664:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311920000 00000100:00100000:1.0:1787134546.650670:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311920000 00000100:00100000:1.0:1787134546.650801:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787134546.650810:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064c2aeda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5864:x1873946311920000:12345-0@lo:502: 00000100:00100000:1.0:1787134546.651051:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064c2aeda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5864:x1873946311920000:12345-0@lo:502: Request processed in 243us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134546.651059:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787134546.651126:0:5864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002b340124 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5864:1873946311920000:0@lo:502: 00000020:01000004:2.0:1787134546.651203:0:5864:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787134546.651218:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e04fa9b1) 00000020:00000080:2.0:1787134546.651240:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787134546.651417:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000090e5dcb7 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787134546.651421:0:5864:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000090e5dcb7 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787134546.651424:0:5864:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000090e5dcb7 4 00010000:00080000:2.0:1787134546.651451:0:5864:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000b8a9d8a4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:2.0:1787134546.653129:0:5864:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787134546.653277:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787134546.653314:0:5864:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787134546.653327:0:5864:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x69932dacae905b85 00000100:00080000:2.0:1787134546.653336:0:5864:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787134546.653341:0:5864:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b8a9d8a4 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787134546.653373:0:5864:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002b340124 x1873946311920128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787134546.653410:0:5864:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787134546.653684:0:5864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ff890cc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5864:1873946311920256:0@lo:502: 00000100:00100000:2.0:1787134546.653770:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134546.655984:0:5864:0:(client.c:2702:ptlrpc_set_wait()) set 000000003f0dd0f2 going to sleep for 11 seconds 00000100:00100000:3.0:1787134546.656118:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311920256 00000100:00100000:3.0:1787134546.656127:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311920256 00000100:00100000:3.0:1787134546.656187:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002b340124 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946311920128:0@lo:38: 00000100:00100000:3.0:1787134546.656261:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134546.656299:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311920128 00000100:00100000:3.0:1787134546.656303:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311920128 00000100:00100000:3.0:1787134546.656331:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787134546.656337:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000781246cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1873946311920128:12345-0@lo:38: 00000100:00100000:3.0:1787134546.656392:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000781246cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1873946311920128:12345-0@lo:38: Request processed in 55us (132us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787134546.656400:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787134546.656436:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787134546.656443:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000b8a9d8a4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787134546.656447:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787134546.656450:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002b340124 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946311920128:0@lo:38: 00000100:00100000:3.0:1787134546.656488:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787134546.656494:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f743d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5864:x1873946311920256:12345-0@lo:502: 00000100:00100000:3.0:1787134546.656978:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f743d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5864:x1873946311920256:12345-0@lo:502: Request processed in 483us (3207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134546.656985:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787134546.658833:0:5864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ff890cc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5864:1873946311920256:0@lo:502: 00000040:00080000:2.0:1787134546.658881:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787134546.659072:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787134546.659095:0:5817:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787134546.659118:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 000000003a4db5ae/0x69932dacae905b70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134546.659129:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 000000003a4db5ae/0x69932dacae905b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787134546.659202:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787134546.659205:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787134546.659209:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787134546.659210:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787134546.659212:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787134546.659213:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787134546.659214:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787134546.659215:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787134546.659216:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787134546.659217:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787134546.659219:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787134546.659220:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787134546.659223:0:5817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787134546.659225:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787134546.659226:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787134546.659227:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787134546.659228:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787134546.659229:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787134546.659230:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787134546.659231:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787134546.659232:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787134546.659233:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787134546.659233:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787134546.659234:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787134546.659235:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787134546.659255:0:5817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787134546.659269:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311920384:0@lo:253: 00000100:00100000:1.0:1787134546.659328:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134546.659353:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0ff137b going to sleep for 11 seconds 00000100:00100000:1.0:1787134546.659373:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311920384 00000100:00100000:1.0:1787134546.659379:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311920384 00000100:00100000:1.0:1787134546.659422:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787134546.659429:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a850b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5817:x1873946311920384:12345-0@lo:253: 20000000:01000000:1.0:1787134546.659456:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787134546.659472:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787134546.690281:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787134546.690304:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787134546.690420:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787134546.690426:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787134546.690449:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.690472:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b54 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.690480:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.690523:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905b54 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134546.690539:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905b54 expref: 12 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134546.690553:0:5851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1873946311920512:0@lo:104: 00000100:00100000:0.0:1787134546.690625:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134546.690684:0:5851:0:(client.c:2702:ptlrpc_set_wait()) set 000000006791566a going to sleep for 11 seconds 00000100:00100000:2.0:1787134546.690763:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311920512 00000100:00100000:2.0:1787134546.690772:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311920512 00000100:00100000:2.0:1787134546.690822:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134546.690830:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000effda031 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5851:x1873946311920512:12345-0@lo:104: 00010000:00010000:2.0:1787134546.690843:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.690897:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787134546.690903:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000effda031 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5851:x1873946311920512:12345-0@lo:104: Request processed in 74us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134546.690910:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787134546.690929:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134546.690934:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.690942:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c2f74c67 already unused, calling callback (0000000011fc32df) 10000000:00010000:2.0:1787134546.690945:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.690953:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134546.690959:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134546.690965:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787134546.690990:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.690997:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787134546.691026:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691033:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: 00000000c2f74c67/0x69932dacae905b54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691049:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134546.691051:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134546.691053:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134546.691113:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ff890cc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311920640:0@lo:103: 00000100:00100000:2.0:1787134546.691140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134546.691226:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311920640 00000100:00100000:2.0:1787134546.691230:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311920640 00010000:00010000:2.0:1787134546.691245:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b54 expref: 13 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134546.691266:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134546.691272:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a7fa3df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3308:x1873946311920640:12345-0@lo:103: 00010000:00010000:2.0:1787134546.691281:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134546.691284:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b54 expref: 13 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691293:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905b54 expref: 13 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691308:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691315:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787134546.691336:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000911417s 00010000:00010000:2.0:1787134546.691339:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691346:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691351:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691356:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691360:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000094130db3 already unused, calling callback (00000000e500d2c7) 00010000:00010000:2.0:1787134546.691364:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691370:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691376:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691384:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134546.691411:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a7fa3df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3308:x1873946311920640:12345-0@lo:103: Request processed in 140us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134546.691417:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134546.691450:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ff890cc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311920640:0@lo:103: 00010000:00010000:2.0:1787134546.691475:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000378a2f93/0x69932dacae905b5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905b54 expref: 12 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134546.691492:0:5851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b87a41df pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1873946311920512:0@lo:104: 00010000:00010000:2.0:1787134546.691507:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691515:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691519:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134546.691524:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000094130db3/0x69932dacae905b8c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134546.702943:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a850b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:5817:x1873946311920384:12345-0@lo:253: Request processed in 43503us (43603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134546.702960:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787134546.703045:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5817:1873946311920384:0@lo:253: 10000000:01000000:1.0:1787134546.703079:0:5817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787134546.703082:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787134546.703084:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787134546.703086:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787134546.703086:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787134546.703087:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787134546.703089:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787134546.703090:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787134546.703091:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787134546.703093:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787134546.703094:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787134546.703095:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787134546.703096:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787134546.703109:0:5817:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787134546.709961:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134546.710485:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134546.710687:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134546.710931:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134546.711151:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787134546.711593:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134546.713930:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134546.714127:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134546.714345:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134546.714514:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134546.714825:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134546.715029:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787134546.765641:0:5817:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787134546.794879:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787134546.795241:0:5870:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1787134546.802786:0:5869:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787134546.802794:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787134546.816341:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787134546.817865:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787134546.818311:0:5817:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787134546.818322:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787134546.818497:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787134546.821710:0:5817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787134546.822288:0:5817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787134546.822338:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787134546.822656:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787134546.827455:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787134546.828926:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787134546.829086:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787134546.829256:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787134546.829412:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787134546.829552:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787134546.829711:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787134546.829877:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787134546.830034:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787134546.830219:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787134546.830377:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787134546.830519:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787134546.830675:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787134546.837623:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787134546.842131:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787134546.842300:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787134546.842484:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787134546.845820:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787134546.846034:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787134546.846200:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787134546.846355:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787134546.846503:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787134546.846675:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787134546.846849:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787134546.847022:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787134546.847223:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787134546.847374:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787134546.847504:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787134546.847659:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787134546.856524:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787134546.856773:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787134546.856920:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787134546.857072:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787134546.857285:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787134546.862521:0:5870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787134547.031482:0:5817:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787134547.031523:0:5817:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbeb4c1bb3988 00100000:10000000:0.0:1787134547.031535:0:5817:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787134547.032428:0:5817:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787134547.032444:0:5817:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787134547.032480:0:5817:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787134547.032538:0:5817:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787134547.051984:0:5870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787134547.054819:0:5870:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1787134547.054831:0:5870:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787134547.339799:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134548.354609:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134549.384041:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134550.400308:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134551.429519:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787134551.684876:0:6113:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787134551.937913:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787134551.937922:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787134551.937925:0:37:0:(import.c:65:import_set_state_nolock()) 00000000b8a9d8a4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787134551.937952:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b8a9d8a4 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787134551.937980:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008bd5e645 x1873946311920896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787134551.938132:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008bd5e645 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946311920896:0@lo:38: 00000100:00100000:3.0:1787134551.938221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134551.938292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311920896 00000100:00100000:3.0:1787134551.938300:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311920896 00000100:00100000:3.0:1787134551.938335:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134551.938342:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001fae9851 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1873946311920896:12345-0@lo:38: 00010000:00080000:3.0:1787134551.938366:0:5837:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1787134551.938404:0:5837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x69932dacae905b93 00000004:00100000:3.0:1787134551.938496:0:5837:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787134551.938616:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000fa1bfa3b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787134551.938683:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001fae9851 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873946311920896:12345-0@lo:38: Request processed in 340us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134551.938691:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787134551.938753:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008bd5e645 x1873946311920896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787134561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787134551.938770:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787134551.938776:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787134551.938781:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787134551.938783:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000b8a9d8a4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787134551.938789:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008bd5e645 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946311920896:0@lo:38: 10000000:01000000:0.0:1787134551.939925:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787134551.939931:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98aa4da38000 from 3 10000000:01000000:0.0:1787134551.939936:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787134551.939974:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000c4431675/0x69932dacae905b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134551.939986:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000c4431675/0x69932dacae905b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134551.939996:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000c4431675/0x69932dacae905b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134551.940016:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000159607c3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311921024:0@lo:101: 00000100:00100000:0.0:1787134551.940084:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134551.940114:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 000000000414735c going to sleep for 11 seconds 00000100:00100000:0.0:1787134551.940198:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ff890cc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311920768:0@lo:400: 00000100:00100000:0.0:1787134551.940225:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134551.941283:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311921024 00000100:00100000:3.0:1787134551.941294:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311921024 00000100:00100000:3.0:1787134551.941340:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311920768 00000100:00100000:3.0:1787134551.941343:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311920768 00000100:00100000:3.0:1787134551.941359:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787134551.941374:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000068d570b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311921024:12345-0@lo:101: 00010000:00010000:3.0:1787134551.941390:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134551.941406:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000237f3ad1/0x69932dacae905ba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905b9a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134551.941430:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000237f3ad1/0x69932dacae905ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905b9a expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134551.941441:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000237f3ad1/0x69932dacae905ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b9a expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134551.941452:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000237f3ad1, rc 0) 00000100:00100000:1.0:1787134551.941503:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787134551.941511:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047054b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3309:x1873946311920768:12345-0@lo:400: 00000100:00100000:1.0:1787134551.945631:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047054b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3309:x1873946311920768:12345-0@lo:400: Request processed in 4114us (5398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134551.945713:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787134551.945796:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ff890cc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311920768:0@lo:400: 00000100:00100000:3.0:1787134551.945908:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000068d570b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311921024:12345-0@lo:101: Request processed in 4534us (5823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134551.945914:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787134551.945992:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000159607c3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311921024:0@lo:101: 00010000:00010000:1.0:1787134551.946014:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000c4431675/0x69932dacae905b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134551.946026:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000c4431675/0x69932dacae905b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134551.946093:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311921152:0@lo:256: 00000100:00100000:1.0:1787134551.946133:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134551.946230:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 000000006663e270 going to sleep for 11 seconds 00000100:00100000:3.0:1787134551.951812:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311921152 00000100:00100000:3.0:1787134551.951829:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311921152 00000100:00100000:3.0:1787134551.951893:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787134551.951902:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a358adbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311921152:12345-0@lo:256: 20000000:01000000:3.0:1787134551.951927:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787134551.951943:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787134551.951945:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787134551.952078:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a358adbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311921152:12345-0@lo:256: Request processed in 177us (5943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134551.952086:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787134551.952210:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311921152:0@lo:256: 10000000:01000000:1.0:1787134551.952261:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787134551.952270:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000c4431675/0x69932dacae905b9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134551.952281:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000c4431675/0x69932dacae905b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134552.448356:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134553.473567:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134554.496993:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134555.522773:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134556.544337:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787134556.729514:0:6315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcac3f6fc0 20000000:00000080:0.0:1787134556.729534:0:6315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98aa434bcc00 uarg=0000000000000000 20000000:01000000:0.0:1787134556.729572:0:6315:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787134556.729581:0:6315:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787134556.729586:0:6315:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787134556.729821:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787134556.729834:0:6315:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787134556.743746:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134556.744015:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787134556.744068:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787134556.744113:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787134556.744129:0:6315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787134556.744146:0:6315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134556.744817:0:6315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b62 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134556.744826:0:6315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134556.744865:0:6315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905b62 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134556.744880:0:6315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905b62 expref: 11 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134556.744895:0:6315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1873946311921280:0@lo:104: 00000100:00100000:1.0:1787134556.744960:0:6315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134556.745017:0:6315:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f87cf61b going to sleep for 11 seconds 00000100:00100000:3.0:1787134556.745997:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311921280 00000100:00100000:3.0:1787134556.746007:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311921280 00000100:00100000:3.0:1787134556.746055:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134556.746077:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc699b78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:6315:x1873946311921280:12345-0@lo:104: 00010000:00010000:3.0:1787134556.746090:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746190:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787134556.746195:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc699b78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:6315:x1873946311921280:12345-0@lo:104: Request processed in 121us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134556.746203:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787134556.746224:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134556.746229:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746237:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e31745ca already unused, calling callback (0000000011fc32df) 10000000:00010000:3.0:1787134556.746241:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746256:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134556.746262:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134556.746267:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787134556.746299:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746306:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134556.746323:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746339:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: 00000000e31745ca/0x69932dacae905b62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746355:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134556.746357:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134556.746359:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134556.746562:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000555a49e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311921408:0@lo:103: 00000100:00100000:3.0:1787134556.746597:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134556.746665:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311921408 00000100:00100000:3.0:1787134556.746669:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311921408 00010000:00010000:3.0:1787134556.746687:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b62 expref: 12 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134556.746712:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134556.746718:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e8ac2ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:3310:x1873946311921408:12345-0@lo:103: 00010000:00010000:3.0:1787134556.746728:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134556.746734:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b62 expref: 12 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746744:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905b62 expref: 12 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746760:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746768:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746780:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746792:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746798:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746803:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746808:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001f83b26e already unused, calling callback (00000000e500d2c7) 00010000:00010000:3.0:1787134556.746811:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746818:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746826:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134556.746836:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134556.746866:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e8ac2ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:3310:x1873946311921408:12345-0@lo:103: Request processed in 149us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134556.746872:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134556.746908:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000555a49e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311921408:0@lo:103: 00010000:00010000:0.0:1787134556.752277:0:6315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000391c7385/0x69932dacae905b69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905b62 expref: 11 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134556.752298:0:6315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fc7219a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1873946311921280:0@lo:104: 00010000:00010000:0.0:1787134556.752321:0:6315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134556.752331:0:6315:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134556.752335:0:6315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134556.752340:0:6315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001f83b26e/0x69932dacae905ba8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134557.057854:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787134557.057922:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f873738a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311921536:0@lo:400: 00000100:00100000:0.0:1787134557.058013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134557.058090:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311921536 00000100:00100000:0.0:1787134557.058100:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311921536 00000100:00100000:0.0:1787134557.058143:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787134557.058150:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084b1a847 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:3308:x1873946311921536:12345-0@lo:400: 00000100:00100000:0.0:1787134557.058227:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084b1a847 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:3308:x1873946311921536:12345-0@lo:400: Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134557.058235:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787134557.058282:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f873738a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311921536:0@lo:400: 00000100:00100000:0.0:1787134557.058313:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f873738a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311921664:0@lo:400: 00000100:00100000:0.0:1787134557.058354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134557.058384:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311921664 00000100:00100000:0.0:1787134557.058387:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311921664 00000100:00100000:0.0:1787134557.058412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787134557.058417:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de49ffc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311921664:12345-0@lo:400: 00000100:00100000:0.0:1787134557.058445:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de49ffc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311921664:12345-0@lo:400: Request processed in 29us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134557.058451:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787134557.058474:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f873738a x1873946311921664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134557.058485:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f873738a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311921664:0@lo:400: 00010000:00010000:1.0:1787134557.614170:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134558.657014:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787134558.720526:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787134558.720533:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa4da38000 from 1 10000000:01000000:3.0:1787134558.720538:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787134558.720584:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000b7536145/0x69932dacae905baf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134558.720616:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000b7536145/0x69932dacae905baf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134558.720628:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000b7536145/0x69932dacae905baf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134558.720667:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000555a49e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311921792:0@lo:101: 00000100:00100000:3.0:1787134558.720736:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134558.720788:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f8b84bab going to sleep for 11 seconds 00000100:00100000:0.0:1787134558.722072:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311921792 00000100:00100000:0.0:1787134558.722084:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311921792 00000100:00100000:0.0:1787134558.722185:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787134558.722195:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000326e4db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:5832:x1873946311921792:12345-0@lo:101: 00010000:00010000:0.0:1787134558.722215:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134558.722237:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000094130db3/0x69932dacae905bb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905baf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134558.722277:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094130db3/0x69932dacae905bb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905baf expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134558.722288:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000094130db3/0x69932dacae905bb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905baf expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134558.722299:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000094130db3, rc 0) 00000100:00100000:0.0:1787134558.722382:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000326e4db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311921792:12345-0@lo:101: Request processed in 188us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134558.722389:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787134558.722477:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000555a49e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311921792:0@lo:101: 00010000:00010000:2.0:1787134558.722493:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000b7536145/0x69932dacae905baf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134558.722500:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000b7536145/0x69932dacae905baf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134558.722560:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e119740c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311921920:0@lo:501: 00000100:00100000:2.0:1787134558.722591:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134558.725522:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 00000000358e0b00 going to sleep for 11 seconds 00000100:00100000:3.0:1787134558.725599:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311921920 00000100:00100000:3.0:1787134558.725608:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311921920 00000100:00100000:3.0:1787134558.725682:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787134558.725691:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007b663690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311921920:12345-0@lo:501: 00000100:00100000:3.0:1787134558.725998:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007b663690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311921920:12345-0@lo:501: Request processed in 308us (3406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134558.726141:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787134558.726459:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e119740c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311921920:0@lo:501: 00000100:00100000:2.0:1787134558.726504:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e119740c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311922048:0@lo:503: 00000100:00100000:2.0:1787134558.726553:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134558.726629:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 00000000358e0b00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134558.726948:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311922048 00000100:00100000:0.0:1787134558.726954:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311922048 00000100:00100000:3.0:1787134558.727118:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787134558.727128:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d26fbac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311922048:12345-0@lo:503: 00000100:00100000:3.0:1787134558.727493:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d26fbac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311922048:12345-0@lo:503: Request processed in 368us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134558.727501:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787134558.727784:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e119740c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311922048:0@lo:503: 00000100:00100000:0.0:1787134558.728437:0:6385:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f873738a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6385:1873946311922176:0@lo:502: 00000100:00100000:0.0:1787134558.728490:0:6385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134558.728568:0:6385:0:(client.c:2702:ptlrpc_set_wait()) set 000000004b931733 going to sleep for 11 seconds 00000100:00100000:3.0:1787134558.728608:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311922176 00000100:00100000:3.0:1787134558.728799:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311922176 00000100:00100000:3.0:1787134558.729132:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787134558.729141:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f024101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6385:x1873946311922176:12345-0@lo:502: 00000100:00100000:3.0:1787134558.729546:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f024101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6385:x1873946311922176:12345-0@lo:502: Request processed in 406us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134558.729560:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787134558.729673:0:6385:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f873738a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6385:1873946311922176:0@lo:502: 00000020:01000000:2.0:1787134558.729702:0:6385:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787134558.729711:0:6385:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134558.729713:0:6385:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787134558.729719:0:6385:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa4da38000 00000020:00000080:2.0:1787134558.729721:0:6385:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787134558.729766:0:6385:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6385:1873946311922304:0@lo:502: 00000100:00100000:2.0:1787134558.729808:0:6385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134558.730359:0:6385:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa58dbd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787134558.730469:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311922304 00000100:00100000:0.0:1787134558.730475:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311922304 00000100:00100000:0.0:1787134558.730504:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787134558.730512:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6385:x1873946311922304:12345-0@lo:502: 00000100:00100000:0.0:1787134558.730761:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6385:x1873946311922304:12345-0@lo:502: Request processed in 249us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134558.730768:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787134558.730869:0:6385:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6385:1873946311922304:0@lo:502: 00000020:01000000:2.0:1787134558.730893:0:6385:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787134558.730898:0:6385:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134558.730900:0:6385:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787134558.730905:0:6385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787134558.731090:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787134558.731108:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787134558.731117:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134558.731139:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134559.691040:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134560.705486:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134561.734482:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134562.177664:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311922432:0@lo:400: 00000100:00100000:0.0:1787134562.177686:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311922560:0@lo:400: 00000100:00100000:1.0:1787134562.182455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134562.182629:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311922560 00000100:00100000:2.0:1787134562.182638:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311922560 00000100:00100000:2.0:1787134562.182709:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787134562.182722:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311922560:12345-0@lo:400: 00000100:00100000:2.0:1787134562.182790:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311922560:12345-0@lo:400: Request processed in 71us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134562.182797:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787134562.182887:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98aa6aa8e680 x1873946311922560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134562.182922:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311922560:0@lo:400: 00000100:00100000:3.0:1787134562.184835:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134562.185092:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311922432 00000100:00100000:0.0:1787134562.185102:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311922432 00000100:00100000:0.0:1787134562.185584:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787134562.185611:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:3309:x1873946311922432:12345-0@lo:400: 00000100:00100000:1.0:1787134562.185855:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311922432:0@lo:400: 00000100:00100000:0.0:1787134562.185961:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:3309:x1873946311922432:12345-0@lo:400: Request processed in 98us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134562.185969:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787134562.752695:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787134563.300633:0:6678:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787134563.300638:0:6678:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787134563.300846:0:6678:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98aa438c0800 00000020:01000004:2.0:1787134563.300865:0:6678:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787134563.300878:0:6678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787134563.300903:0:6678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98aa6ff5cd40) 00000020:00000080:2.0:1787134563.300925:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787134563.313924:0:6678:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787134563.314210:0:6678:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787134563.358145:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787134563.361580:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787134563.362030:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787134563.362093:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787134563.362118:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787134563.362501:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787134563.362516:0:6678:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787134563.362525:0:6678:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x69932dacae905bc4 00000020:01000004:2.0:1787134563.362533:0:6678:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787134563.362553:0:6678:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.136@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787134563.362557:0:6678:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787134563.362564:0:6678:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787134563.362568:0:6678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787134563.362580:0:6678:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98aa6ff599c0) 00000020:00000080:2.0:1787134563.362601:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787134563.371480:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134563.373642:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787134563.373654:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787134563.377299:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787134563.377308:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787134563.377973:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787134563.377981:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787134563.390084:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787134563.390290:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787134563.390296:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787134563.391206:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787134563.391224:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787134563.443323:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134563.443616:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787134563.443624:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787134563.449092:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787134563.449112:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787134563.452196:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787134563.452210:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787134563.461084:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134563.461360:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787134563.461367:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787134563.462131:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787134563.462138:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787134563.545567:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787134563.546959:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787134563.546968:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787134563.548465:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787134563.548476:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787134563.552065:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787134563.552106:0:6678:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787134563.552113:0:6678:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787134563.596833:0:6678:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787134563.596869:0:6678:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.136@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787134563.596873:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787134563.596874:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787134563.596876:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134563.596941:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134563.596943:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134563.596944:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134563.596946:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787134563.596947:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787134563.596949:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787134563.596950:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134563.596952:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787134563.596956:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787134563.596958:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787134563.596959:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787134563.596960:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134563.596961:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134563.596963:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134563.596964:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134563.596969:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787134563.596970:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787134563.596971:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787134563.596972:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134563.596973:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787134563.596998:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787134563.597014:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311922688:0@lo:253: 00000100:00100000:0.0:1787134563.597076:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134563.597190:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81454300 going to sleep for 11 seconds 00000100:00100000:3.0:1787134563.597290:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311922688 00000100:00100000:3.0:1787134563.597297:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311922688 00000100:00100000:3.0:1787134563.597377:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787134563.597386:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311922688:12345-0@lo:253: 20000000:01000000:3.0:1787134563.597421:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787134563.597425:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787134563.597435:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787134563.597438:0:5829:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787134563.598357:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787134563.598550:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787134563.598563:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787134563.598609:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787134563.598616:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787134563.598646:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787134563.598690:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787134563.599042:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787134563.599061:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.136@tcp 20000000:01000000:3.0:1787134563.599063:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:3.0:1787134563.599098:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787134563.599106:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787134563.599145:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787134563.599152:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:3.0:1787134563.599213:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787134563.599222:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787134563.599245:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787134563.599284:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787134563.600027:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787134563.600046:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.136@tcp 20000000:01000000:3.0:1787134563.600048:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:3.0:1787134563.600082:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787134563.600089:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787134563.600122:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787134563.600129:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:3.0:1787134563.600210:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787134563.600219:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787134563.600270:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787134563.600309:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787134563.600325:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787134563.600333:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787134563.600337:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787134563.600349:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787134563.600351:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787134563.600380:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787134563.600382:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787134563.607131:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787134563.607964:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787134563.608014:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787134563.608094:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787134563.608110:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787134563.608113:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787134563.609842:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787134563.609990:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787134563.610024:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787134563.615804:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787134563.615995:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787134563.616067:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787134563.616088:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787134563.616091:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787134563.620080:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787134563.620203:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787134563.620264:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787134563.620617:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787134563.620662:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787134563.620723:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787134563.620743:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787134563.620745:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787134563.620754:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787134563.620772:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.620790:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa413fc600/0x69932dacae905aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905ae4 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.620799:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa59dea600/0x69932dacae905b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b00 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.620805:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa40030400/0x69932dacae905b77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b70 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.620826:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.620866:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa40030400/0x69932dacae905b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905b70 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.620890:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa40030400/0x69932dacae905b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905b70 expref: 12 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134563.620905:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1873946311922816:0@lo:104: 00000100:00100000:1.0:1787134563.620965:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787134563.621022:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa59dea600/0x69932dacae905b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905b00 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.621030:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa59dea600/0x69932dacae905b07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905b00 expref: 12 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134563.621037:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1873946311922944:0@lo:104: 00000100:00100000:1.0:1787134563.621057:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787134563.621084:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa413fc600/0x69932dacae905aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905ae4 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.621091:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa413fc600/0x69932dacae905aeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905ae4 expref: 12 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134563.621099:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1873946311923072:0@lo:104: 00000100:00100000:1.0:1787134563.621118:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134563.621128:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7ae6eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787134563.621524:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311922816 00000100:00100000:2.0:1787134563.621533:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311922816 00000100:00100000:2.0:1787134563.621570:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311922944 00000100:00100000:2.0:1787134563.621574:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311922944 00000100:00100000:2.0:1787134563.621584:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311923072 00000100:00100000:2.0:1787134563.621586:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311923072 00000100:00100000:2.0:1787134563.621611:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787134563.621619:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:5829:x1873946311922816:12345-0@lo:104: 00010000:00010000:2.0:1787134563.621632:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa821c4a00/0x69932dacae905b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.621711:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787134563.621718:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:5829:x1873946311922816:12345-0@lo:104: Request processed in 100us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134563.621725:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787134563.621741:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787134563.621747:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:5829:x1873946311922944:12345-0@lo:104: 00010000:00010000:2.0:1787134563.621754:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa40031800/0x69932dacae905b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.621785:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787134563.621790:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:5829:x1873946311922944:12345-0@lo:104: Request processed in 44us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134563.621796:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787134563.621807:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787134563.621812:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5829:x1873946311923072:12345-0@lo:104: 00010000:00010000:2.0:1787134563.621819:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.621844:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787134563.621849:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5829:x1873946311923072:12345-0@lo:104: Request processed in 37us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134563.621854:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787134563.621869:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787134563.621875:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa821c4a00/0x69932dacae905b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.621989:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa821c4a00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1787134563.622001:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c4a00/0x69932dacae905b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622009:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa821c4a00/0x69932dacae905b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134563.622016:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c4a00/0x69932dacae905b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134563.622023:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787134563.622053:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa821c4a00/0x69932dacae905b70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622060:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787134563.622085:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa821c4a00/0x69932dacae905b70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.622087:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311923200:0@lo:103: 00010000:00010000:2.0:1787134563.622092:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa821c4a00/0x69932dacae905b70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622105:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787134563.622108:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa40031800/0x69932dacae905b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622114:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa40031800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1787134563.622117:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031800/0x69932dacae905b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.622117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787134563.622124:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa40031800/0x69932dacae905b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134563.622140:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031800/0x69932dacae905b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134563.622146:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787134563.622186:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa40031800/0x69932dacae905b00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622192:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787134563.622202:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa40031800/0x69932dacae905b00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622209:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa40031800/0x69932dacae905b00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905b07 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622219:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787134563.622220:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787134563.622222:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.622226:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311923328:0@lo:103: 00010000:00010000:2.0:1787134563.622228:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa40030a00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1787134563.622231:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622237:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134563.622244:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.622247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1787134563.622250:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787134563.622273:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905ae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622280:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787134563.622299:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905ae4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622307:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905ae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905aeb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.622323:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134563.622325:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134563.622326:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134563.622333:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134563.622339:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134563.622348:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311923456:0@lo:103: 00000100:00100000:2.0:1787134563.622373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.622543:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311923200 00000100:00100000:3.0:1787134563.622549:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311923200 00010000:00010000:3.0:1787134563.622575:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa40030400/0x69932dacae905b77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b70 expref: 13 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.622609:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311923328 00000100:00100000:3.0:1787134563.622613:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311923328 00010000:00010000:3.0:1787134563.622624:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa59dea600/0x69932dacae905b07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b00 expref: 14 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.622637:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787134563.622644:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:3307:x1873946311923200:12345-0@lo:103: 00010000:00010000:3.0:1787134563.622654:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134563.622659:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa40030400/0x69932dacae905b77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b70 expref: 14 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.622669:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa40030400/0x69932dacae905b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905b70 expref: 14 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.622685:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134563.622720:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:3307:x1873946311923200:12345-0@lo:103: Request processed in 77us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134563.622727:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787134563.622741:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787134563.622747:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3307:x1873946311923328:12345-0@lo:103: 00010000:00010000:3.0:1787134563.622760:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134563.622764:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa59dea600/0x69932dacae905b07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b00 expref: 13 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.622764:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311923200:0@lo:103: 00010000:00010000:3.0:1787134563.622772:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa59dea600/0x69932dacae905b07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905b00 expref: 13 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.622781:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134563.622808:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3307:x1873946311923328:12345-0@lo:103: Request processed in 61us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134563.622815:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134563.622816:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311923328:0@lo:103: 00010000:00010000:3.0:1787134563.622860:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa40030400/0x69932dacae905b77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905b70 expref: 12 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.622870:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1873946311922816:0@lo:104: 00000100:00100000:0.0:1787134563.623331:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311923456 00000100:00100000:0.0:1787134563.623336:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311923456 00010000:00010000:0.0:1787134563.623412:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa413fc600/0x69932dacae905aeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905ae4 expref: 12 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.623444:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134563.623451:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:3310:x1873946311923456:12345-0@lo:103: 00010000:00010000:0.0:1787134563.623467:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134563.623473:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa413fc600/0x69932dacae905aeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905ae4 expref: 12 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623482:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa413fc600/0x69932dacae905aeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905ae4 expref: 12 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623495:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623503:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.623504:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea600/0x69932dacae905b07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905b00 expref: 12 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.623515:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1873946311922944:0@lo:104: 00010000:00010000:0.0:1787134563.623518:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623525:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.623530:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa413fc600/0x69932dacae905aeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905ae4 expref: 11 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623532:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.623539:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1873946311923072:0@lo:104: 00010000:00010000:3.0:1787134563.623557:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.623566:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.623583:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787134563.623600:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1787134563.623618:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623626:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134563.623630:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623826:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623848:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623855:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea200/0x69932dacae905bd2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.623868:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134563.626889:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:3310:x1873946311923456:12345-0@lo:103: Request processed in 3431us (4507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.626903:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134563.626963:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311923456:0@lo:103: 00000100:00100000:1.0:1787134563.696846:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:6678:x1873946311922688:12345-0@lo:253: Request processed in 99449us (99757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134563.696879:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787134563.696997:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311922688:0@lo:253: 10000000:01000000:0.0:1787134563.697013:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787134563.697016:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787134563.697018:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787134563.697019:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134563.697021:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787134563.697022:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134563.697023:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134563.697025:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787134563.697026:0:6678:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787134563.697028:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134563.697029:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787134563.697047:0:6678:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98aa438c0800 from lustre-OST0000 10000000:01000000:0.0:1787134563.697075:0:6678:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787134563.697078:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787134563.697084:0:6678:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98aa6aa4b380 local copy 10000000:01000000:0.0:1787134563.697089:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787134563.697122:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.697143:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.697154:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.697208:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311923584:0@lo:101: 00000100:00100000:0.0:1787134563.697243:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134563.697297:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81454300 going to sleep for 11 seconds 00000100:00100000:3.0:1787134563.697415:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311923584 00000100:00100000:3.0:1787134563.697422:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311923584 00000100:00100000:3.0:1787134563.697461:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787134563.697469:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:6678:x1873946311923584:12345-0@lo:101: 00010000:00010000:3.0:1787134563.697481:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134563.697494:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa821c5800/0x69932dacae905be0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905bd9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.697516:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa821c5800/0x69932dacae905be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905bd9 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.697525:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa821c5800/0x69932dacae905be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905bd9 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.697535:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa821c5800, rc 0) 00000100:00100000:3.0:1787134563.697581:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:6678:x1873946311923584:12345-0@lo:101: Request processed in 113us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134563.697596:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787134563.697722:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311923584:0@lo:101: 00010000:00010000:2.0:1787134563.697735:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.697744:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134563.697839:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311923712:0@lo:501: 00000100:00100000:2.0:1787134563.697877:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134563.697895:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd78180 going to sleep for 11 seconds 00000100:00100000:1.0:1787134563.697966:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311923712 00000100:00100000:1.0:1787134563.697971:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311923712 00000100:00100000:1.0:1787134563.697998:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787134563.698005:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:6678:x1873946311923712:12345-0@lo:501: 00000100:00100000:1.0:1787134563.698224:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:6678:x1873946311923712:12345-0@lo:501: Request processed in 218us (357us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787134563.698231:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787134563.698370:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311923712:0@lo:501: 10000000:01000000:2.0:1787134563.698383:0:6678:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787134563.698414:0:6678:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787134563.698420:0:6678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.698429:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.698436:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.698458:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787134563.698475:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98aa438c0800 10000000:01000000:2.0:1787134563.698480:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787134563.698484:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98aa6aa4b380 10000000:01000000:2.0:1787134563.698487:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787134563.698490:0:6678:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98aa6aa4b380 from 1 10000000:01000000:2.0:1787134563.698492:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787134563.698508:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.698516:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.698524:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134563.698535:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311923840:0@lo:101: 00000100:00100000:2.0:1787134563.698571:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134563.698600:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd78840 going to sleep for 11 seconds 00010000:00010000:1.0:1787134563.698708:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134563.698714:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.698722:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa40031200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134563.698726:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.698734:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134563.698741:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134563.698747:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787134563.698765:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.698771:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787134563.698794:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.698811:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905bd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x69932dacae905be0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.698826:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134563.698828:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134563.698830:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134563.698839:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311923840 00000100:00100000:1.0:1787134563.698843:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311923840 00000100:00100000:1.0:1787134563.698862:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787134563.698868:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:6678:x1873946311923840:12345-0@lo:101: 00010000:00010000:1.0:1787134563.698876:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134563.698888:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59deb200/0x69932dacae905bee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905be7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.698903:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59deb200/0x69932dacae905bee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905be7 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.698911:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59deb200/0x69932dacae905bee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905be7 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.698919:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb200, rc 0) 00000100:00100000:1.0:1787134563.698947:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311923840:12345-0@lo:101: Request processed in 79us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134563.698953:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787134563.699113:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134563.699126:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311923968:0@lo:103: 00000100:00100000:0.0:1787134563.699197:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134563.699911:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311923968 00000100:00100000:1.0:1787134563.699919:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311923968 00000100:00100000:1.0:1787134563.699966:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787134563.699973:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:3309:x1873946311923968:12345-0@lo:103: 00010000:00010000:1.0:1787134563.699994:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134563.700008:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa821c5800/0x69932dacae905be0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905bd9 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.700022:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134563.700058:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:3309:x1873946311923968:12345-0@lo:103: Request processed in 86us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134563.700065:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134563.700702:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311923840:0@lo:101: 00010000:00010000:2.0:1787134563.700733:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905bee expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.700744:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905bee expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134563.700764:0:6678:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787134563.700780:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905bee expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.700788:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905bee expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134563.700796:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787134563.700800:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787134563.700806:0:6678:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787134563.700809:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787134563.700833:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.700840:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.700848:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134563.700864:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924096:0@lo:101: 00000100:00100000:2.0:1787134563.700900:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134563.700925:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd78840 going to sleep for 11 seconds 00000100:00100000:0.0:1787134563.701021:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311923968:0@lo:103: 00000100:00100000:1.0:1787134563.701226:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311924096 00000100:00100000:1.0:1787134563.701232:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311924096 00000100:00100000:0.0:1787134563.703687:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787134563.703709:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+10:6678:x1873946311924096:12345-0@lo:101: 00010000:00010000:0.0:1787134563.703727:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134563.703748:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905bf5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.703780:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905bf5 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.703792:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905bf5 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.703803:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa40030400, rc 0) 00000100:00100000:0.0:1787134563.703888:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924096:12345-0@lo:101: Request processed in 189us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.703910:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787134563.704045:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924096:0@lo:101: 00010000:00010000:2.0:1787134563.704073:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.704083:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134563.704249:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924224:0@lo:501: 00000100:00100000:2.0:1787134563.704284:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134563.712492:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd78840 going to sleep for 11 seconds 00000100:00100000:3.0:1787134563.714693:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311924224 00000100:00100000:3.0:1787134563.714711:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311924224 00000100:00100000:0.0:1787134563.715061:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787134563.715073:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924224:12345-0@lo:501: 00000100:00100000:0.0:1787134563.715433:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924224:12345-0@lo:501: Request processed in 360us (11147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.715441:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787134563.717480:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924224:0@lo:501: 00000100:00100000:3.0:1787134563.717556:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924352:0@lo:503: 00000100:00100000:3.0:1787134563.717648:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.717707:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50bc96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134563.720176:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311924352 00000100:00100000:0.0:1787134563.720191:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311924352 00000100:00100000:0.0:1787134563.720251:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787134563.720260:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924352:12345-0@lo:503: 00000100:00100000:0.0:1787134563.720508:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924352:12345-0@lo:503: Request processed in 247us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.720516:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787134563.720751:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924352:0@lo:503: 00000040:00080000:3.0:1787134563.721057:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787134563.721123:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924480:0@lo:502: 00000100:00100000:3.0:1787134563.721206:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.721285:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50bc96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134563.724181:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311924480 00000100:00100000:1.0:1787134563.724208:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311924480 00000100:00100000:2.0:1787134563.725238:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787134563.725337:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924480:12345-0@lo:502: 00000100:00100000:0.0:1787134563.725694:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924480:12345-0@lo:502: Request processed in 443us (4488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.725703:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787134563.725922:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924480:0@lo:502: 00000040:00080000:2.0:1787134563.726247:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787134563.726302:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787134563.726333:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787134563.726378:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787134563.726414:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787134563.726444:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787134563.726478:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924608:0@lo:502: 00000100:00100000:2.0:1787134563.726528:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134563.726844:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd78cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134563.728010:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311924608 00000100:00100000:0.0:1787134563.728023:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311924608 00000100:00100000:0.0:1787134563.728089:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787134563.728098:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924608:12345-0@lo:502: 00000100:00100000:0.0:1787134563.728352:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924608:12345-0@lo:502: Request processed in 254us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.728360:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787134563.730778:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924608:0@lo:502: 00000040:00080000:2.0:1787134563.730987:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787134563.731008:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787134563.732103:0:6697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787134563.732112:0:6697:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787134563.732119:0:6697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134563.732121:0:6697:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787134563.732126:0:6697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787134563.732148:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98aa6ff5b380) 00000020:00000080:2.0:1787134563.732187:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787134563.732194:0:6697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787134563.732267:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa438c0800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787134563.732274:0:6697:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787134563.732281:0:6697:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x69932dacae905c0a 00010000:00010000:3.0:1787134563.743854:0:6697:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787134563.744313:0:6697:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787134563.751037:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787134563.751507:0:6697:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787134563.767397:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787134563.768336:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787134563.770603:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787134563.770617:0:6697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134563.770624:0:6697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134563.770627:0:6697:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787134563.770631:0:6697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787134563.770635:0:6697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134563.770636:0:6697:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787134563.770638:0:6697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787134563.770639:0:6697:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787134563.770698:0:6697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134563.770702:0:6697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134563.770704:0:6697:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787134563.770707:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787134563.771683:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787134563.771710:0:6678:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787134563.771733:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.771747:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134563.771755:0:6678:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa438c0800 from 1 10000000:01000000:3.0:1787134563.771758:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787134563.771794:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.771802:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.771813:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.771847:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924736:0@lo:101: 00000100:00100000:3.0:1787134563.771927:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.771974:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa815389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134563.772512:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311924736 00000100:00100000:3.0:1787134563.772520:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311924736 00000100:00100000:3.0:1787134563.772580:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787134563.772599:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:6678:x1873946311924736:12345-0@lo:101: 00010000:00010000:3.0:1787134563.772614:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134563.772631:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905c11 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.772658:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905c11 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.772670:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c11 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.772680:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa821c5c00, rc 0) 00000100:00100000:3.0:1787134563.772725:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311924736:12345-0@lo:101: Request processed in 137us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134563.772732:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787134563.772785:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924736:0@lo:101: 00010000:00010000:3.0:1787134563.772799:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.772807:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.772912:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924864:0@lo:501: 00000100:00100000:3.0:1787134563.772956:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.772980:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa815389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134563.773257:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311924864 00000100:00100000:2.0:1787134563.773262:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311924864 00000100:00100000:2.0:1787134563.773293:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787134563.773301:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311924864:12345-0@lo:501: 00000100:00100000:2.0:1787134563.773532:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311924864:12345-0@lo:501: Request processed in 231us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134563.773539:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787134563.773894:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924864:0@lo:501: 00000100:00100000:3.0:1787134563.773931:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924992:0@lo:503: 00000100:00100000:3.0:1787134563.773972:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.774003:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa815389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134563.774108:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311924992 00000100:00100000:2.0:1787134563.774113:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311924992 00000100:00100000:2.0:1787134563.774144:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787134563.774150:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311924992:12345-0@lo:503: 00000100:00100000:2.0:1787134563.774431:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311924992:12345-0@lo:503: Request processed in 281us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134563.774438:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787134563.774807:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311924992:0@lo:503: 00000040:00080000:3.0:1787134563.775071:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787134563.775125:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925120:0@lo:502: 00000100:00100000:3.0:1787134563.775198:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.775219:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50bc9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787134563.775602:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311925120 00000100:00100000:2.0:1787134563.775607:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311925120 00000100:00100000:2.0:1787134563.775632:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787134563.775638:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311925120:12345-0@lo:502: 00000100:00100000:2.0:1787134563.775797:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311925120:12345-0@lo:502: Request processed in 158us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134563.775804:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787134563.775985:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925120:0@lo:502: 00000040:00080000:3.0:1787134563.776245:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787134563.776289:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787134563.776313:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925248:0@lo:502: 00000100:00100000:3.0:1787134563.776348:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.776373:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa815389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134563.776473:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311925248 00000100:00100000:0.0:1787134563.776479:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311925248 00000100:00100000:0.0:1787134563.776505:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787134563.776512:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311925248:12345-0@lo:502: 00000100:00100000:0.0:1787134563.776672:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311925248:12345-0@lo:502: Request processed in 159us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.776679:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1787134563.777702:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134563.777782:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925248:0@lo:502: 00000040:00080000:3.0:1787134563.778279:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787134563.778294:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787134563.779490:0:6701:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134563.779502:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134563.779504:0:6701:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787134563.779511:0:6701:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa438c0800 00000020:00000080:1.0:1787134563.779514:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787134563.779535:0:6701:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134563.779954:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134563.779956:0:6701:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787134563.779960:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787134563.780090:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787134563.780112:0:6678:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787134563.780133:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.780145:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134563.780386:0:6678:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787134563.780389:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98aa438c0800 10000000:01000000:3.0:1787134563.780392:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98aa438c0800 10000000:01000000:3.0:1787134563.780396:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787134563.780402:0:6678:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa438c0800 from 1 10000000:01000000:3.0:1787134563.780405:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787134563.780437:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.780446:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.780457:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.780481:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925376:0@lo:101: 00000100:00100000:3.0:1787134563.780956:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.781005:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50bc9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787134563.781261:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311925376 00000100:00100000:1.0:1787134563.781269:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311925376 00000100:00100000:1.0:1787134563.781314:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787134563.781323:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311925376:12345-0@lo:101: 00010000:00010000:1.0:1787134563.781335:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134563.781350:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905c1f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.781373:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905c1f expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.781393:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c1f expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.781402:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb600, rc 0) 00000100:00100000:1.0:1787134563.781454:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311925376:12345-0@lo:101: Request processed in 132us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134563.781461:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787134563.782199:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925376:0@lo:101: 00010000:00010000:3.0:1787134563.782217:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.782228:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.782329:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925504:0@lo:501: 00000100:00100000:3.0:1787134563.782365:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.782405:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50bc9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134563.782549:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311925504 00000100:00100000:0.0:1787134563.782555:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311925504 00000100:00100000:0.0:1787134563.782605:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787134563.782614:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311925504:12345-0@lo:501: 00000100:00100000:0.0:1787134563.782895:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311925504:12345-0@lo:501: Request processed in 282us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.782903:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787134563.782941:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925504:0@lo:501: 00000100:00100000:0.0:1787134563.782970:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925632:0@lo:503: 00000100:00100000:0.0:1787134563.783010:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134563.783030:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81429cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134563.783126:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311925632 00000100:00100000:3.0:1787134563.783130:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311925632 00000100:00100000:3.0:1787134563.783179:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787134563.783187:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311925632:12345-0@lo:503: 00000100:00100000:3.0:1787134563.783325:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311925632:12345-0@lo:503: Request processed in 138us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134563.783331:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787134563.783797:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925632:0@lo:503: 00000040:00080000:0.0:1787134563.784074:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787134563.784135:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925760:0@lo:502: 00000100:00100000:0.0:1787134563.784203:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134563.784233:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81429cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134563.784699:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311925760 00000100:00100000:3.0:1787134563.784705:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311925760 00000100:00100000:3.0:1787134563.784749:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787134563.784757:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311925760:12345-0@lo:502: 00000100:00100000:3.0:1787134563.784953:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311925760:12345-0@lo:502: Request processed in 196us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134563.784961:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787134563.785143:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925760:0@lo:502: 00000040:00080000:0.0:1787134563.786367:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787134563.786432:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787134563.786466:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787134563.786507:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787134563.786550:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787134563.786607:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787134563.786642:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787134563.786675:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787134563.786722:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787134563.786754:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787134563.786781:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787134563.786821:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787134563.786849:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787134563.786874:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787134563.786958:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787134563.786994:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787134563.787027:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787134563.787086:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787134563.787128:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787134563.787196:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787134563.787249:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787134563.787286:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787134563.787331:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787134563.787392:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787134563.787433:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787134563.787466:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787134563.787515:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787134563.787550:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787134563.787606:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925888:0@lo:502: 00000100:00100000:0.0:1787134563.787677:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134563.787716:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81429cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134563.788380:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311925888 00000100:00100000:3.0:1787134563.788389:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311925888 00000100:00100000:3.0:1787134563.788439:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787134563.788449:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311925888:12345-0@lo:502: 00000100:00100000:3.0:1787134563.788704:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311925888:12345-0@lo:502: Request processed in 256us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134563.788711:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787134563.790263:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311925888:0@lo:502: 00000040:00080000:1.0:1787134563.790385:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787134563.790401:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787134563.791508:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787134563.791523:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98aa6ff899c0) 00000020:00000080:3.0:1787134563.791624:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787134563.791868:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa438c0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787134563.791872:0:6702:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98aa438c0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787134563.791886:0:6702:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa438c0800 3 00010000:00080000:3.0:1787134563.791921:0:6702:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa7faa8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.136@tcp at head 00010000:00010000:3.0:1787134563.794135:0:6702:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787134563.794371:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787134563.794405:0:6702:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787134563.794417:0:6702:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x69932dacae905c34 00000100:00080000:3.0:1787134563.794428:0:6702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787134563.794433:0:6702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98aa7faa8800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787134563.794470:0:6702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa73cc7b80 x1873946311926016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787134563.794502:0:6702:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787134563.794774:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1873946311926016:0@lo:38: 00000100:00100000:1.0:1787134563.794842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134563.795077:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787134563.795087:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311926144:0@lo:400: 00000100:00100000:0.0:1787134563.795116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134563.795145:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311926016 00000100:00100000:0.0:1787134563.795152:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311926016 00000100:00100000:0.0:1787134563.795203:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311926144 00000100:00100000:0.0:1787134563.795206:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311926144 00000100:00100000:0.0:1787134563.795232:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787134563.795241:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311926144:12345-0@lo:400: 00000100:00100000:0.0:1787134563.795291:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311926144:12345-0@lo:400: Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.795299:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787134563.795314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787134563.795318:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1873946311926016:12345-0@lo:38: 00010000:00080000:0.0:1787134563.795338:0:5836:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1787134563.795365:0:5836:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x69932dacae905c3b 00000004:00100000:0.0:1787134563.795380:0:5836:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787134563.795409:0:5836:0:(import.c:65:import_set_state_nolock()) ffff98aa74089000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787134563.795446:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873946311926016:12345-0@lo:38: Request processed in 125us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.795461:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787134563.795497:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6ff80a80 x1873946311926144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134563.795511:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311926144:0@lo:400: 00010000:00080000:0.0:1787134563.795670:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa73cc7b80 x1873946311926016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787134573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134563.795680:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787134563.795686:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787134563.795694:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787134563.795698:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787134563.795700:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa7faa8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787134563.795705:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1873946311926016:0@lo:38: 00000040:00080000:3.0:1787134563.796365:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787134563.798717:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787134563.798758:0:6678:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787134563.798789:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134563.798801:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787134563.799467:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787134563.799469:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787134563.799470:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787134563.799471:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787134563.799472:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787134563.799473:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787134563.799474:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787134563.799475:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787134563.799476:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787134563.799481:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787134563.799482:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787134563.799485:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787134563.799487:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787134563.799488:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787134563.799488:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787134563.799489:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787134563.799489:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787134563.799490:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787134563.799491:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787134563.799491:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787134563.799492:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787134563.799492:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787134563.799493:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787134563.799520:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787134563.799833:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311926272:0@lo:253: 00000100:00100000:1.0:1787134563.799975:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134563.800050:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7ae6e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787134563.802100:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311926272 00000100:00100000:3.0:1787134563.802112:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311926272 00000100:00100000:3.0:1787134563.802181:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787134563.802384:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6678:x1873946311926272:12345-0@lo:253: 20000000:01000000:3.0:1787134563.802416:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787134563.802429:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787134563.841493:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787134563.841520:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787134563.841661:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787134563.841667:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787134563.841690:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.841712:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa821c4000/0x69932dacae905ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905b9a expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.841721:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.841771:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa821c4000/0x69932dacae905ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905b9a expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134563.841801:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa821c4000/0x69932dacae905ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905b9a expref: 13 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134563.841817:0:5851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1873946311926400:0@lo:104: 00000100:00100000:3.0:1787134563.842062:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134563.842183:0:5851:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa48038780 going to sleep for 11 seconds 00000100:00100000:2.0:1787134563.842188:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311926400 00000100:00100000:2.0:1787134563.842202:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311926400 00000100:00100000:2.0:1787134563.842243:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787134563.842252:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5851:x1873946311926400:12345-0@lo:104: 00010000:00010000:2.0:1787134563.842264:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.842330:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787134563.842337:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5851:x1873946311926400:12345-0@lo:104: Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134563.842344:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787134563.842357:0:5851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1873946311926400:0@lo:104: 00010000:00010000:3.0:1787134563.842374:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.842449:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134563.842457:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.842465:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa40030c00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134563.842469:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.842477:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134563.842484:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134563.842489:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134563.842533:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905b9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.842540:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787134563.842599:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311926528:0@lo:103: 00000100:00100000:3.0:1787134563.842632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787134563.842679:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905b9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.842687:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905b9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ba1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.842704:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134563.842706:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134563.842708:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134563.842718:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311926528 00000100:00100000:0.0:1787134563.842722:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311926528 00010000:00010000:0.0:1787134563.842742:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa821c4000/0x69932dacae905ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b9a expref: 14 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.842770:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787134563.842777:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa47fad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:3308:x1873946311926528:12345-0@lo:103: 00010000:00010000:0.0:1787134563.842804:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134563.842810:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa821c4000/0x69932dacae905ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905b9a expref: 14 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.842821:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa821c4000/0x69932dacae905ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905b9a expref: 14 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843013:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa821c4000/0x69932dacae905ba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905b9a expref: 14 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843025:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843038:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787134563.843051:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001385502s 00010000:00010000:0.0:1787134563.843055:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843061:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843068:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843073:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843078:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa821c4200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134563.843082:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843088:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843109:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134563.843118:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134563.843210:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134563.843217:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.843223:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa47fad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3308:x1873946311926528:12345-0@lo:103: Request processed in 447us (590us total) trans 0 rc 0/0 00010000:00010000:2.0:1787134563.843224:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa821c4200/0x69932dacae905c42 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134563.843230:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787134563.843374:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311926528:0@lo:103: 00000100:00100000:0.0:1787134563.861915:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:6678:x1873946311926272:12345-0@lo:253: Request processed in 59715us (61930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134563.861932:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787134563.862054:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6678:1873946311926272:0@lo:253: 10000000:01000000:1.0:1787134563.862069:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787134563.862073:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787134563.862074:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787134563.862076:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787134563.862077:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787134563.862078:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787134563.862079:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787134563.862081:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787134563.862082:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787134563.862083:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787134563.862085:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787134563.862087:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787134563.862102:0:6678:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787134563.870072:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134563.870368:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134563.870567:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134563.871104:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134563.871362:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134563.871653:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787134563.872992:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787134564.162249:0:6678:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787134564.162257:0:6678:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787134564.162296:0:6678:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787134564.162357:0:6678:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787134564.162372:0:6678:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787134564.162408:0:6678:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787134564.803723:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134565.827635:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134566.851256:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787134567.299234:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787134567.299244:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa4da38000 from 21 10000000:01000000:2.0:1787134567.299251:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787134567.299925:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134567.299940:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134567.299951:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134567.299990:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311926656:0@lo:101: 00000100:00100000:2.0:1787134567.300062:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134567.300197:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa434b9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134567.305844:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311926656 00000100:00100000:0.0:1787134567.305861:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311926656 00000100:00100000:0.0:1787134567.305932:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787134567.305945:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311926656:12345-0@lo:101: 00010000:00010000:0.0:1787134567.305964:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134567.305984:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905c49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134567.306015:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905c49 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134567.306028:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c49 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134567.306039:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa40031400, rc 0) 00000100:00100000:0.0:1787134567.308091:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311926656:12345-0@lo:101: Request processed in 2140us (8017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134567.308105:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787134567.319213:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311926656:0@lo:101: 00010000:00010000:3.0:1787134567.319253:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.319266:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134567.319388:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311926784:0@lo:501: 00000100:00100000:3.0:1787134567.319472:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.319532:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50886c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134567.321046:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311926784 00000100:00100000:0.0:1787134567.321060:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311926784 00000100:00100000:0.0:1787134567.321117:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787134567.321138:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311926784:12345-0@lo:501: 00000100:00100000:0.0:1787134567.321484:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311926784:12345-0@lo:501: Request processed in 348us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134567.321493:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787134567.321912:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311926784:0@lo:501: 00000100:00100000:0.0:1787134567.321959:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311926912:0@lo:503: 00000100:00100000:0.0:1787134567.322004:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134567.322033:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787134567.322049:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311926912 00000100:00100000:0.0:1787134567.322054:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311926912 00000100:00100000:0.0:1787134567.322079:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787134567.322087:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311926912:12345-0@lo:503: 00000100:00100000:0.0:1787134567.322270:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311926912:12345-0@lo:503: Request processed in 183us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134567.322277:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787134567.322315:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311926912:0@lo:503: 00000100:00100000:3.0:1787134567.332390:0:6863:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6863:1873946311927040:0@lo:502: 00000100:00100000:3.0:1787134567.332506:0:6863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.332552:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311927040 00000100:00100000:3.0:1787134567.332572:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311927040 00000100:00100000:3.0:1787134567.332617:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787134567.332625:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6863:x1873946311927040:12345-0@lo:502: 00000100:00100000:3.0:1787134567.333243:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6863:x1873946311927040:12345-0@lo:502: Request processed in 616us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.333251:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787134567.333316:0:6863:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50886000 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.333350:0:6863:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6863:1873946311927040:0@lo:502: 00000100:00100000:3.0:1787134567.333409:0:6863:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6863:1873946311927168:0@lo:502: 00000100:00100000:3.0:1787134567.333443:0:6863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.333468:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311927168 00000100:00100000:3.0:1787134567.333472:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311927168 00000100:00100000:3.0:1787134567.333496:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787134567.333503:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6863:x1873946311927168:12345-0@lo:502: 00000100:00100000:3.0:1787134567.333638:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:6863:x1873946311927168:12345-0@lo:502: Request processed in 135us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.333645:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787134567.333671:0:6863:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa622a6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.333683:0:6863:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6863:1873946311927168:0@lo:502: 00000040:00080000:3.0:1787134567.333701:0:6863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787134567.333763:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787134567.333782:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787134567.333808:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.333831:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134567.333843:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787134567.333846:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98aa4da38000 from 4 10000000:01000000:3.0:1787134567.333849:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787134567.333878:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.333886:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.333896:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134567.333908:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927296:0@lo:101: 00000100:00100000:3.0:1787134567.333934:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.333948:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa622a6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.333961:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311927296 00000100:00100000:3.0:1787134567.333965:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311927296 00000100:00100000:3.0:1787134567.333986:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787134567.333992:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311927296:12345-0@lo:101: 00010000:00010000:3.0:1787134567.334000:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134567.334013:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905c57 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334032:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905c57 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334053:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c57 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334062:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa821c4800, rc 0) 00000100:00100000:3.0:1787134567.334093:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311927296:12345-0@lo:101: Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.334099:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787134567.334127:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927296:0@lo:101: 00010000:00010000:3.0:1787134567.334137:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334146:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134567.334211:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927424:0@lo:256: 00000100:00100000:3.0:1787134567.334241:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.334252:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa622a6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.334262:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311927424 00000100:00100000:3.0:1787134567.334265:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311927424 00000100:00100000:3.0:1787134567.334284:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787134567.334291:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311927424:12345-0@lo:256: 20000000:01000000:3.0:1787134567.334304:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787134567.334321:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787134567.334325:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787134567.334398:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311927424:12345-0@lo:256: Request processed in 107us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.334404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787134567.334438:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927424:0@lo:256: 10000000:01000000:3.0:1787134567.334476:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787134567.334481:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334489:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134567.334496:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787134567.334497:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787134567.334499:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787134567.334511:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334518:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334525:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134567.334535:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927552:0@lo:101: 00000100:00100000:3.0:1787134567.334572:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.334585:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa62224780 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.334596:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311927552 00000100:00100000:3.0:1787134567.334599:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311927552 00000100:00100000:3.0:1787134567.334619:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787134567.334625:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311927552:12345-0@lo:101: 00010000:00010000:3.0:1787134567.334632:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134567.334642:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905c65 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334662:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905c65 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334671:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c65 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334678:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa821c4000, rc 0) 00000100:00100000:3.0:1787134567.334705:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311927552:12345-0@lo:101: Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.334711:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787134567.334736:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927552:0@lo:101: 00010000:00010000:3.0:1787134567.334746:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.334753:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134567.334791:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927680:0@lo:501: 00000100:00100000:3.0:1787134567.334813:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.334824:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa62224780 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.334833:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311927680 00000100:00100000:3.0:1787134567.334836:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311927680 00000100:00100000:3.0:1787134567.334854:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787134567.334859:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311927680:12345-0@lo:501: 00000100:00100000:3.0:1787134567.335066:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311927680:12345-0@lo:501: Request processed in 206us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.335073:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787134567.335110:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927680:0@lo:501: 00000100:00100000:3.0:1787134567.335134:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927808:0@lo:503: 00000100:00100000:3.0:1787134567.335191:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.335205:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa438a36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.335215:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311927808 00000100:00100000:3.0:1787134567.335219:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311927808 00000100:00100000:3.0:1787134567.335238:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787134567.335243:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311927808:12345-0@lo:503: 00000100:00100000:3.0:1787134567.345400:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311927808:12345-0@lo:503: Request processed in 10142us (10194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.345424:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787134567.345735:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311927808:0@lo:503: 00000100:00100000:1.0:1787134567.360869:0:6865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6865:1873946311927936:0@lo:502: 00000100:00100000:1.0:1787134567.360972:0:6865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134567.361018:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311927936 00000100:00100000:1.0:1787134567.361025:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311927936 00000100:00100000:1.0:1787134567.361073:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787134567.361081:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:6865:x1873946311927936:12345-0@lo:502: 00000100:00100000:1.0:1787134567.361403:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:6865:x1873946311927936:12345-0@lo:502: Request processed in 321us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134567.361412:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787134567.361474:0:6865:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa507263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134567.361497:0:6865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6865:1873946311927936:0@lo:502: 00000020:01000000:1.0:1787134567.361530:0:6865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787134567.361538:0:6865:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787134567.361546:0:6865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134567.361548:0:6865:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787134567.361564:0:6865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787134567.361568:0:6865:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.136@tcp to nid 0x20000c0a8ca88 (192.168.202.136@tcp) 00000020:01000000:1.0:1787134567.361593:0:6865:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787134567.361595:0:6865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787134567.361608:0:6865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98aa6aa4cd40) 00000020:00000080:1.0:1787134567.361631:0:6865:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787134567.361638:0:6865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787134567.361715:0:6865:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787134567.361720:0:6865:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787134567.361728:0:6865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae905c7a 00010000:00080000:1.0:1787134567.361767:0:6865:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa52a7c800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:1.0:1787134567.362004:0:6865:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787134567.408044:0:6865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787134567.408070:0:6865:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787134567.408724:0:6865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787134567.408896:0:6865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787134567.408948:0:6865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787134567.409011:0:6865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787134567.409660:0:6866:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134567.409666:0:6866:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787134567.410707:0:6865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787134567.410720:0:6865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787134567.410760:0:6865:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787134567.410782:0:6865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae905c81 00000100:00080000:1.0:1787134567.410804:0:6865:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787134567.410811:0:6865:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98aa52a7c800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787134567.412046:0:6865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa6aa8fb80 x1873946311928064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787134567.412082:0:6865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787134567.412250:0:6865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134567.412256:0:6865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134567.412258:0:6865:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787134567.412262:0:6865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787134567.412266:0:6865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134567.412268:0:6865:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787134567.412271:0:6865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787134567.412273:0:6865:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787134567.412308:0:6865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6865:1873946311928192:0@lo:502: 00000100:00100000:0.0:1787134567.412403:0:6865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134567.412460:0:6865:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787134567.412545:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946311928064:0@lo:8: 00000100:00100000:1.0:1787134567.412598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134567.412679:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311928064 00000100:00100000:0.0:1787134567.412687:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311928064 00000100:00100000:0.0:1787134567.412728:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787134567.412735:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1873946311928064:12345-0@lo:8: 00010000:00080000:0.0:1787134567.412763:0:6680:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:0.0:1787134567.412792:0:6680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae905c88 00002000:00100000:0.0:1787134567.412832:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98aa7408a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211390b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787134567.412837:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787134567.412841:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787134567.412974:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787134567.413129:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787134567.413153:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98aa7408c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787134567.413231:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1873946311928064:12345-0@lo:8: Request processed in 494us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134567.413246:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787134567.413343:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8fb80 x1873946311928064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787134577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134567.413354:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787134567.413362:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787134567.413370:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787134567.413376:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787134567.413378:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa52a7c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787134567.413396:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787134567.413402:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946311928064:0@lo:8: 00000100:00100000:3.0:1787134567.413602:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311928192 00000100:00100000:3.0:1787134567.413607:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311928192 00000100:00100000:3.0:1787134567.413647:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787134567.413655:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:6865:x1873946311928192:12345-0@lo:502: 00000100:00100000:3.0:1787134567.413879:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:6865:x1873946311928192:12345-0@lo:502: Request processed in 225us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.413887:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787134567.414030:0:6865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:6865:1873946311928192:0@lo:502: 00000020:01000000:3.0:1787134567.414059:0:6865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134567.414065:0:6865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134567.414067:0:6865:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787134567.414072:0:6865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787134567.414272:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787134567.414292:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787134567.414301:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134567.414312:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134567.414329:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787134567.414331:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98aa6aa4b380 from 1 10000000:01000000:1.0:1787134567.414334:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787134567.414361:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134567.414369:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134567.414378:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134567.414395:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311928320:0@lo:101: 00000100:00100000:1.0:1787134567.414427:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134567.414463:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50726180 going to sleep for 11 seconds 00000004:00080000:0.0:1787134567.414781:0:6866:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787134567.414871:0:6866:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 183381711530ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787134567.414969:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311928320 00000100:00100000:3.0:1787134567.414974:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311928320 00000100:00100000:3.0:1787134567.415014:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787134567.415024:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311928320:12345-0@lo:101: 00010000:00010000:3.0:1787134567.415043:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134567.415057:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905c8f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.415080:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905c8f expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.415091:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c8f expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134567.415102:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa821c5800, rc 0) 00000100:00100000:3.0:1787134567.415244:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311928320:12345-0@lo:101: Request processed in 222us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.415251:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787134567.416179:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311928448:0@lo:400: 00000100:00100000:0.0:1787134567.416244:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134567.416285:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134567.416293:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311928576:0@lo:400: 00000100:00100000:0.0:1787134567.416318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134567.416349:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311928448 00000100:00100000:0.0:1787134567.416355:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311928448 00000100:00100000:0.0:1787134567.416390:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311928576 00000100:00100000:0.0:1787134567.416392:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311928576 00000100:00100000:0.0:1787134567.416420:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134567.416428:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311928448:12345-0@lo:400: 00000100:00100000:0.0:1787134567.416474:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311928448:12345-0@lo:400: Request processed in 47us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134567.416481:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134567.416494:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134567.416501:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311928576:12345-0@lo:400: 00000100:00100000:0.0:1787134567.416546:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311928576:12345-0@lo:400: Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134567.416552:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787134567.416594:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6ff87100 x1873946311928576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134567.416608:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311928576:0@lo:400: 00010000:00080000:0.0:1787134567.416618:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6ff86a00 x1873946311928448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134567.416626:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311928448:0@lo:400: 00000100:00080000:2.0:1787134567.416835:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134567.419968:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311928320:0@lo:101: 00010000:00010000:1.0:1787134567.419998:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134567.420013:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134567.421119:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311928704:0@lo:501: 00000100:00100000:0.0:1787134567.421220:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134567.421270:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787134567.422908:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311928704 00000100:00100000:2.0:1787134567.422922:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311928704 00000100:00100000:2.0:1787134567.422974:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787134567.422985:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311928704:12345-0@lo:501: 00000100:00100000:2.0:1787134567.426765:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311928704:12345-0@lo:501: Request processed in 3771us (5533us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787134567.426781:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787134567.426887:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311928704:0@lo:501: 10000000:01000000:2.0:1787134567.426937:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787134567.426949:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134567.426962:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787134567.498032:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787134567.498195:0:6867:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787134567.498224:0:6867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1873946311928960:0@lo:7: 00000100:00100000:3.0:1787134567.498312:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.498360:0:6867:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa51339540 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.498381:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787134567.498390:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311928832:0@lo:13: 00000100:00100000:3.0:1787134567.498419:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134567.498479:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311928832 00000100:00100000:1.0:1787134567.498488:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311928832 00000100:00100000:1.0:1787134567.498915:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787134567.498926:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1873946311928832:12345-0@lo:13: 00002000:00000024:1.0:1787134567.498959:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787134567.499012:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1873946311928832:12345-0@lo:13: Request processed in 88us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134567.499033:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787134567.499081:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa73cc5c00 x1873946311928832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134567.499102:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311928832:0@lo:13: 00000100:00080000:3.0:1787134567.499625:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787134567.505018:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311928960 00000100:00100000:3.0:1787134567.505035:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311928960 00000100:00100000:3.0:1787134567.505701:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134567.505714:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6867:x1873946311928960:12345-0@lo:7: 00002000:00080000:3.0:1787134567.529010:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787134567.529022:0:6682:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787134567.529153:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6867:x1873946311928960:12345-0@lo:7: Request processed in 23438us (30836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.529182:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787134567.529407:0:6867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa73cc4000 x1873946311928960/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787134583 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134567.529425:0:6867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1873946311928960:0@lo:7: 00000004:00080000:2.0:1787134567.529440:0:6867:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787134567.529492:0:6867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1873946311929088:0@lo:5: 00000100:00100000:2.0:1787134567.531016:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134567.531091:0:6867:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa434b9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.531188:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311929088 00000100:00100000:3.0:1787134567.531196:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311929088 00000100:00100000:3.0:1787134567.532692:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787134567.532712:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6867:x1873946311929088:12345-0@lo:5: 00002000:00080000:3.0:1787134567.532748:0:6681:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787134567.532752:0:6681:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787134567.533131:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6867:x1873946311929088:12345-0@lo:5: Request processed in 426us (2121us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787134567.533139:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787134567.533204:0:6867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6ff87480 x1873946311929088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787134583 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134567.533222:0:6867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1873946311929088:0@lo:5: 00000004:00080000:3.0:1787134567.533235:0:6867:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787134567.533295:0:6867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1873946311929216:0@lo:700: 00000100:00100000:3.0:1787134567.533329:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134567.533359:0:6867:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa51339180 going to sleep for 11 seconds 00000100:00100000:1.0:1787134567.536787:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311929216 00000100:00100000:1.0:1787134567.536807:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311929216 00000100:00100000:1.0:1787134567.536958:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787134567.536969:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6867:x1873946311929216:12345-0@lo:700: 00000100:00100000:1.0:1787134567.537030:0:6689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1873946311929344:0@lo:700: 00000100:00100000:1.0:1787134567.537660:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134567.537697:0:6689:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50726180 going to sleep for 11 seconds 00000100:00100000:1.0:1787134567.537723:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311929344 00000100:00100000:1.0:1787134567.537727:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311929344 00000100:00100000:1.0:1787134567.537751:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787134567.537758:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1873946311929344:12345-0@lo:700: 40000000:02000000:1.0:1787134567.592263:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787134567.616016:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1873946311929344:12345-0@lo:700: Request processed in 78250us (78348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134567.616029:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787134567.620151:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8fb80 x1873946311929344/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787134583 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134567.620193:0:6689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1873946311929344:0@lo:700: 40000000:02000000:3.0:1787134567.620208:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787134567.727127:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6867:x1873946311929216:12345-0@lo:700: Request processed in 190152us (193788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134567.727147:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787134567.727189:0:6867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa73cc4700 x1873946311929216/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787134583 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134567.727211:0:6867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1873946311929216:0@lo:700: 00000001:00100000:3.0:1787134567.727219:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787134567.727237:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:1.0:1787134567.771071:0:6867:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787134567.776007:0:6867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1873946311929472:0@lo:5: 00000100:00100000:1.0:1787134567.776107:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134567.776305:0:6867:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa520a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134567.776860:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311929472 00000100:00100000:3.0:1787134567.776870:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311929472 00000100:00100000:1.0:1787134567.777027:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787134567.777038:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6867:x1873946311929472:12345-0@lo:5: 00002000:00080000:1.0:1787134567.783072:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787134567.783101:0:6682:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787134567.787110:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6867:x1873946311929472:12345-0@lo:5: Request processed in 10065us (10993us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787134567.787125:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787134567.788472:0:6867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8f480 x1873946311929472/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787134583 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134567.788494:0:6867:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787134567.788529:0:6867:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff98aa6aa8f480 x1873946311929472/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787134583 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134567.788558:0:6867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1873946311929472:0@lo:5: 00000004:00080000:1.0:1787134567.788577:0:6867:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787134567.873136:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134568.903411:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134569.920622:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787134570.926211:0:7050:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787134570.945390:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134571.968469:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134572.416379:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311929728:0@lo:400: 00000100:00100000:2.0:1787134572.416445:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134572.416575:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134572.416590:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311929600:0@lo:400: 00000100:00100000:0.0:1787134572.416619:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134572.416651:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311929600 00000100:00100000:0.0:1787134572.416657:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311929600 00000100:00100000:0.0:1787134572.416690:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787134572.416696:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:3307:x1873946311929600:12345-0@lo:400: 00000100:00100000:0.0:1787134572.416729:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:3307:x1873946311929600:12345-0@lo:400: Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134572.416734:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787134572.416767:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311929600:0@lo:400: 00000100:00100000:0.0:1787134572.416903:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311929856:0@lo:400: 00000100:00100000:0.0:1787134572.416929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134572.417004:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311929728 00000100:00100000:2.0:1787134572.417007:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311929728 00000100:00100000:2.0:1787134572.417054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311929856 00000100:00100000:2.0:1787134572.417056:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311929856 00000100:00100000:1.0:1787134572.417112:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134572.417119:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311929984:0@lo:400: 00000100:00100000:1.0:1787134572.417141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787134572.417239:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134572.417251:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311929984 00000100:00100000:0.0:1787134572.417256:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311929984 00000100:00100000:0.0:1787134572.417297:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787134572.417304:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1873946311929984:12345-0@lo:400: 00000100:00100000:0.0:1787134572.417344:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1873946311929984:12345-0@lo:400: Request processed in 41us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134572.417349:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787134572.417443:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787134572.417452:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311929728:12345-0@lo:400: 00000100:00100000:3.0:1787134572.417495:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311929728:12345-0@lo:400: Request processed in 45us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134572.417501:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787134572.417525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787134572.417532:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311929856:12345-0@lo:400: 00000100:00100000:3.0:1787134572.417560:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311929856:12345-0@lo:400: Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134572.417566:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787134572.417632:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8d880 x1873946311929856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134572.417645:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311929856:0@lo:400: 00000100:00080000:1.0:1787134572.417755:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787134572.417774:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8e300 x1873946311929984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134572.417784:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311929984:0@lo:400: 00010000:00080000:2.0:1787134572.420689:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8fb80 x1873946311929728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134572.420709:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311929728:0@lo:400: 00000100:00100000:2.0:1787134572.928717:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311930112:0@lo:13: 00000100:00100000:2.0:1787134572.928820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134572.928981:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311930112 00000100:00100000:3.0:1787134572.928990:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311930112 00000100:00100000:3.0:1787134572.929048:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134572.929058:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1873946311930112:12345-0@lo:13: 00002000:00000024:3.0:1787134572.929095:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134572.929142:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1873946311930112:12345-0@lo:13: Request processed in 85us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134572.929149:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787134572.929278:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8e300 x1873946311930112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134572.929300:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311930112:0@lo:13: 00010000:00010000:3.0:1787134572.992540:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787134573.025774:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787134574.018613:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134575.040920:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134576.064949:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134577.093744:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134577.536390:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311930240:0@lo:400: 00000100:00100000:2.0:1787134577.536488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134577.536601:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311930240 00000100:00100000:3.0:1787134577.536611:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311930240 00000100:00100000:3.0:1787134577.536674:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787134577.536685:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:3309:x1873946311930240:12345-0@lo:400: 00000100:00100000:0.0:1787134577.536778:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311930368:0@lo:400: 00000100:00100000:0.0:1787134577.536814:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134577.536822:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:3309:x1873946311930240:12345-0@lo:400: Request processed in 139us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134577.536830:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787134577.536877:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311930368 00000100:00100000:3.0:1787134577.536880:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311930368 00000100:00100000:3.0:1787134577.536911:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787134577.536918:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311930368:12345-0@lo:400: 00000100:00100000:3.0:1787134577.536971:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311930368:12345-0@lo:400: Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134577.536977:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787134577.536992:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8c380 x1873946311930368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134577.537007:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311930368:0@lo:400: 00000100:00100000:0.0:1787134577.537142:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311930496:0@lo:400: 00000100:00100000:0.0:1787134577.537204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134577.537272:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134577.537279:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311930624:0@lo:400: 00000100:00100000:0.0:1787134577.537307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134577.537351:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311930624 00000100:00100000:3.0:1787134577.537362:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311930496 00000100:00100000:3.0:1787134577.537366:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311930496 00000100:00100000:2.0:1787134577.537432:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311930240:0@lo:400: 00000100:00100000:3.0:1787134577.537441:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787134577.537448:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311930496:12345-0@lo:400: 00000100:00100000:1.0:1787134577.537480:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311930624 00000100:00100000:3.0:1787134577.537507:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311930496:12345-0@lo:400: Request processed in 55us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134577.537513:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787134577.537539:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8ed80 x1873946311930496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134577.537550:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311930496:0@lo:400: 00000100:00080000:0.0:1787134577.537707:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134577.537713:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134577.537732:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787134577.537740:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311930624:12345-0@lo:400: 00000100:00100000:1.0:1787134577.537842:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311930624:12345-0@lo:400: Request processed in 104us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134577.537852:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787134577.537894:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8c380 x1873946311930624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134577.537900:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787134577.537913:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311930624:0@lo:400: 00000100:00100000:1.0:1787134578.050651:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311930752:0@lo:13: 00000100:00100000:1.0:1787134578.050753:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134578.050950:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311930752 00000100:00100000:1.0:1787134578.050965:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311930752 00000100:00100000:1.0:1787134578.051023:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787134578.051035:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311930752:12345-0@lo:13: 00002000:00000024:1.0:1787134578.051256:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134578.051938:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311930752:12345-0@lo:13: Request processed in 899us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134578.051948:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787134578.056727:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8e300 x1873946311930752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134578.056762:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311930752:0@lo:13: 00010000:00010000:1.0:1787134578.113384:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134579.139257:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134580.161560:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134581.184698:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134582.218281:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787134582.362846:0:7614:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787134582.362855:0:7614:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787134582.363144:0:7614:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98aa52a7d800 00000020:01000004:1.0:1787134582.363187:0:7614:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787134582.363205:0:7614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787134582.363304:0:7614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98aa6aa499c0) 00000020:00000080:1.0:1787134582.363329:0:7614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787134582.405337:0:7614:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787134582.405803:0:7614:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787134582.459681:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787134582.468115:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787134582.468199:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787134582.468264:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787134582.468295:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787134582.470978:0:7614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787134582.470996:0:7614:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787134582.471012:0:7614:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x69932dacae905ca4 00000020:01000004:3.0:1787134582.471023:0:7614:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787134582.471050:0:7614:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.136@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787134582.471055:0:7614:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787134582.471063:0:7614:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787134582.471093:0:7614:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787134582.471098:0:7614:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787134582.510822:0:7614:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787134582.510892:0:7614:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.136@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787134582.510898:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787134582.510901:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787134582.510902:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134582.510903:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134582.510905:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134582.510906:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134582.510908:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787134582.510910:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787134582.510911:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787134582.510913:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134582.510914:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787134582.510920:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787134582.510923:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787134582.510924:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787134582.510926:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134582.510927:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134582.510928:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134582.510929:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134582.510930:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787134582.510932:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787134582.510933:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787134582.510934:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134582.510935:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787134582.510985:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787134582.511013:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311930880:0@lo:253: 00000100:00100000:2.0:1787134582.511564:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134582.511700:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa42db2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787134582.511777:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311930880 00000100:00100000:3.0:1787134582.511788:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311930880 00000100:00100000:3.0:1787134582.511913:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787134582.511928:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:7614:x1873946311930880:12345-0@lo:253: 20000000:01000000:3.0:1787134582.511974:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787134582.511979:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787134582.511986:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787134582.511991:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787134582.514559:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134582.514854:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787134582.514877:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787134582.514921:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787134582.514928:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787134582.514961:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787134582.515014:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787134582.515789:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787134582.515833:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.136@tcp 20000000:01000000:1.0:1787134582.515836:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:1.0:1787134582.515873:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787134582.515881:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787134582.515931:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787134582.515940:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:1.0:1787134582.515972:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787134582.515982:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787134582.516011:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787134582.516059:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787134582.517354:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787134582.517485:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.136@tcp 20000000:01000000:1.0:1787134582.517488:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:1.0:1787134582.517532:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787134582.517540:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787134582.517573:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787134582.517580:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:1.0:1787134582.517610:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787134582.517621:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787134582.517671:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787134582.517709:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787134582.517731:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787134582.517735:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787134582.517744:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787134582.517745:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787134582.517749:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787134582.517767:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787134582.517769:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787134582.517818:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787134582.517821:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787134582.522033:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787134582.522807:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787134582.522855:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787134582.523722:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787134582.523776:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787134582.523907:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787134582.523924:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787134582.523927:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787134582.524918:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787134582.524993:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787134582.525049:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787134582.528934:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787134582.529001:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787134582.529036:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787134582.529053:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787134582.529056:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787134582.533782:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787134582.541055:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787134582.541237:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787134582.542636:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787134582.542683:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787134582.542758:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787134582.542773:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787134582.542776:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787134582.545910:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787134582.547726:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787134582.547791:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787134582.547919:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1787134582.547950:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787134582.547976:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.548001:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905bf5 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.548009:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c1f expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.548016:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c49 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.548022:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c65 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.548028:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c8f expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.548047:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.548103:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905c8f expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.548127:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905c8f expref: 16 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134582.548148:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311931008:0@lo:104: 00000100:00100000:2.0:1787134582.549054:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787134582.549146:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905c65 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134582.549293:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787134582.549316:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311931008 00000100:00100000:1.0:1787134582.549325:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311931008 00000100:00100000:1.0:1787134582.549398:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787134582.549410:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa480fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5830:x1873946311931008:12345-0@lo:104: 00010000:00010000:1.0:1787134582.549443:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.549517:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787134582.549524:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa480fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5830:x1873946311931008:12345-0@lo:104: Request processed in 118us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134582.550120:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787134582.550229:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134582.550237:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.550247:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deba00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134582.550251:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.550261:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134582.550296:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134582.550303:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787134582.550348:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.550355:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787134582.550720:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.550728:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa59deba00/0x69932dacae905c8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.550744:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134582.550745:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134582.550747:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134582.550756:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787134582.550776:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311931264:0@lo:103: 00000100:00100000:1.0:1787134582.550859:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134582.550920:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311931264 00000100:00100000:1.0:1787134582.550927:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311931264 00010000:00010000:1.0:1787134582.550955:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c8f expref: 17 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134582.550987:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787134582.550997:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:3309:x1873946311931264:12345-0@lo:103: 00010000:00010000:1.0:1787134582.551011:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134582.551017:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c8f expref: 17 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.551124:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905c65 expref: 17 pid: 5830 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134582.551142:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311931136:0@lo:104: 00000100:00100000:2.0:1787134582.552519:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.552773:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311931136 00000100:00100000:0.0:1787134582.552783:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311931136 00000100:00100000:0.0:1787134582.552848:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787134582.552859:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5830:x1873946311931136:12345-0@lo:104: 00010000:00010000:0.0:1787134582.552901:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.552972:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787134582.552980:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5830:x1873946311931136:12345-0@lo:104: Request processed in 122us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.552989:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787134582.553019:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134582.553027:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.553034:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa821c4200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134582.553040:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.553048:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134582.553056:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134582.553061:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134582.553104:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.553111:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134582.553145:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.553153:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa821c4200/0x69932dacae905c65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.553202:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134582.553204:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134582.553205:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134582.553238:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311931392:0@lo:103: 00000100:00100000:0.0:1787134582.553284:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.553323:0:5821:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787134582.553333:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787134582.553506:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905c8f expref: 17 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.553926:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787134582.553941:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311931392 00000100:00100000:3.0:1787134582.553947:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311931392 00010000:00010000:3.0:1787134582.553974:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c65 expref: 18 pid: 5830 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.553992:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787134582.553999:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787134582.554007:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3307:x1873946311931392:12345-0@lo:103: 00010000:00010000:3.0:1787134582.554020:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134582.554035:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c65 expref: 18 pid: 5830 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.555499:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905c65 expref: 18 pid: 5830 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.555535:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134582.555651:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3307:x1873946311931392:12345-0@lo:103: Request processed in 1643us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.555662:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787134582.555724:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905c49 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.555742:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905c49 expref: 17 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.555759:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311931520:0@lo:104: 00000100:00100000:3.0:1787134582.555801:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787134582.555853:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905c1f expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.555862:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905c1f expref: 17 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.555871:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311931648:0@lo:104: 00000100:00100000:3.0:1787134582.555928:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.555955:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311931520 00000100:00100000:3.0:1787134582.555963:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311931520 00000100:00100000:3.0:1787134582.555995:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311931648 00000100:00100000:3.0:1787134582.555999:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311931648 00000100:00100000:3.0:1787134582.556013:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787134582.556029:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:5830:x1873946311931520:12345-0@lo:104: 00010000:00010000:3.0:1787134582.556044:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556094:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787134582.556100:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:5830:x1873946311931520:12345-0@lo:104: Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.556108:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787134582.556120:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787134582.556127:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5830:x1873946311931648:12345-0@lo:104: 00010000:00010000:3.0:1787134582.556136:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556195:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787134582.556201:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5830:x1873946311931648:12345-0@lo:104: Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.556208:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787134582.556224:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787134582.556232:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556240:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fca00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134582.556245:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556255:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134582.556262:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134582.556277:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787134582.556313:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556321:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134582.556339:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556347:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905c49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c50 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556366:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134582.556370:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556376:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa821c5a00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134582.556379:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556386:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134582.556392:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134582.556397:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787134582.556409:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556427:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134582.556452:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556459:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa821c5a00/0x69932dacae905c1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c26 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556471:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134582.556473:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134582.556475:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134582.556489:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311931776:0@lo:103: 00000100:00100000:3.0:1787134582.556520:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.556554:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787134582.556562:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311931776 00000100:00100000:3.0:1787134582.556566:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311931776 00010000:00010000:3.0:1787134582.556581:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c49 expref: 18 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.556596:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787134582.556603:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787134582.556609:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3308:x1873946311931776:12345-0@lo:103: 00010000:00010000:3.0:1787134582.556620:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134582.556626:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c49 expref: 18 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556636:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905c49 expref: 18 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556651:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134582.556678:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3308:x1873946311931776:12345-0@lo:103: Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.556695:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787134582.556732:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311931776:0@lo:103: 00000100:00100000:3.0:1787134582.556752:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787134582.556760:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311931904:0@lo:103: 00000100:00100000:3.0:1787134582.556786:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.556807:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787134582.556814:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311931904 00000100:00100000:3.0:1787134582.556817:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311931904 00010000:00010000:3.0:1787134582.556829:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c1f expref: 18 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.556842:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787134582.556847:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787134582.556852:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3310:x1873946311931904:12345-0@lo:103: 00010000:00010000:3.0:1787134582.556858:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134582.556862:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c1f expref: 18 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556870:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905c1f expref: 18 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556880:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134582.556904:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3310:x1873946311931904:12345-0@lo:103: Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.556911:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787134582.556932:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311931904:0@lo:103: 00010000:00010000:3.0:1787134582.556966:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905bf5 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.556984:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905bf5 expref: 17 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.556994:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311932032:0@lo:104: 00000100:00100000:3.0:1787134582.557018:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.557036:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311932032 00000100:00100000:3.0:1787134582.557039:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311932032 00000100:00100000:3.0:1787134582.557057:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787134582.557062:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5830:x1873946311932032:12345-0@lo:104: 00010000:00010000:3.0:1787134582.557071:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557102:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787134582.557108:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5830:x1873946311932032:12345-0@lo:104: Request processed in 46us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.557114:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787134582.557129:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134582.557134:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557141:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fc800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134582.557144:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557153:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134582.557185:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134582.557197:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787134582.557221:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557228:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134582.557237:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557243:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa413fc800/0x69932dacae905bf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905bfc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557260:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134582.557262:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134582.557264:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134582.557272:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311932160:0@lo:103: 00000100:00100000:3.0:1787134582.557296:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.557320:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787134582.557325:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311932160 00000100:00100000:3.0:1787134582.557329:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311932160 00010000:00010000:3.0:1787134582.557340:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905bf5 expref: 18 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.557353:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787134582.557357:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787134582.557363:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3310:x1873946311932160:12345-0@lo:103: 00010000:00010000:3.0:1787134582.557371:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134582.557374:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905bf5 expref: 18 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557394:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905bf5 expref: 18 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557408:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557431:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557447:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557455:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557461:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557468:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557472:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fd800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134582.557476:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557485:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557493:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557513:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134582.557542:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3310:x1873946311932160:12345-0@lo:103: Request processed in 179us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.557550:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787134582.557574:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311932160:0@lo:103: 00000100:00100000:3.0:1787134582.557595:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa42db2180 going to sleep for 11 seconds 00010000:00010000:3.0:1787134582.557610:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa821c5800/0x69932dacae905c96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905c8f expref: 17 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.557620:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311931008:0@lo:104: 00010000:00010000:3.0:1787134582.557631:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa821c4000/0x69932dacae905c6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905c65 expref: 16 pid: 5830 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.557641:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311931136:0@lo:104: 00010000:00010000:3.0:1787134582.557653:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa40031400/0x69932dacae905c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905c49 expref: 15 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.557662:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311931520:0@lo:104: 00010000:00010000:3.0:1787134582.557671:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59deb600/0x69932dacae905c26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905c1f expref: 14 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.557679:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311931648:0@lo:104: 00010000:00010000:3.0:1787134582.557686:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa40030400/0x69932dacae905bfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905bf5 expref: 13 pid: 5829 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.557694:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1873946311932032:0@lo:104: 00010000:00010000:3.0:1787134582.557728:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557737:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557744:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.557750:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa413fd800/0x69932dacae905cab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787134582.557762:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787134582.559523:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311931392:0@lo:103: 00010000:00010000:0.0:1787134582.561296:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134582.566502:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134582.566705:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:3309:x1873946311931264:12345-0@lo:103: Request processed in 15703us (15839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134582.566722:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787134582.572336:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311931264:0@lo:103: 00000100:00100000:3.0:1787134582.645320:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:7614:x1873946311930880:12345-0@lo:253: Request processed in 133382us (133744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.645342:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787134582.645508:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311930880:0@lo:253: 10000000:01000000:0.0:1787134582.645530:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787134582.645534:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787134582.645536:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787134582.645538:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134582.645540:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787134582.645541:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134582.645542:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134582.645544:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787134582.645546:0:7614:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787134582.645548:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134582.645549:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787134582.645592:0:7614:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98aa52a7d800 from lustre-OST0001 10000000:01000000:0.0:1787134582.645633:0:7614:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787134582.645637:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787134582.645648:0:7614:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98aa6aa4b380 local copy 10000000:01000000:0.0:1787134582.645653:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787134582.645713:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.645750:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.645761:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134582.645787:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932288:0@lo:101: 00000100:00100000:0.0:1787134582.645839:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.645915:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787134582.646061:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311932288 00000100:00100000:1.0:1787134582.646070:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311932288 00000100:00100000:1.0:1787134582.646124:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787134582.646135:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:7614:x1873946311932288:12345-0@lo:101: 00010000:00010000:1.0:1787134582.646151:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134582.646189:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59deba00/0x69932dacae905cb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905cb2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.646219:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59deba00/0x69932dacae905cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905cb2 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.646230:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59deba00/0x69932dacae905cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905cb2 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.646240:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deba00, rc 0) 00000100:00100000:1.0:1787134582.646278:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311932288:12345-0@lo:101: Request processed in 145us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134582.646284:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787134582.646555:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932288:0@lo:101: 00010000:00010000:0.0:1787134582.646830:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.646841:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134582.646991:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932416:0@lo:501: 00000100:00100000:0.0:1787134582.647041:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.647068:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787134582.647140:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311932416 00000100:00100000:1.0:1787134582.647145:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311932416 00000100:00100000:1.0:1787134582.647205:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787134582.647231:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311932416:12345-0@lo:501: 00000100:00100000:1.0:1787134582.647647:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311932416:12345-0@lo:501: Request processed in 417us (605us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787134582.647656:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787134582.647843:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932416:0@lo:501: 10000000:01000000:2.0:1787134582.647864:0:7614:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787134582.647902:0:7614:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787134582.647910:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.647921:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.647940:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.647970:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787134582.647999:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98aa52a7d800 10000000:01000000:2.0:1787134582.648005:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787134582.648011:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787134582.648014:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787134582.648019:0:7614:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787134582.648032:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787134582.648061:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.648069:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.648079:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134582.648096:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932544:0@lo:101: 00000100:00100000:2.0:1787134582.648131:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134582.648194:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa42db2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.648298:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311932544 00000100:00100000:0.0:1787134582.648304:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311932544 00010000:00010000:3.0:1787134582.648519:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134582.648529:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.648538:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa40031c00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134582.648541:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.648551:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134582.648560:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134582.648578:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787134582.648612:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.648619:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134582.648641:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.648648:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa40031c00/0x69932dacae905cb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x69932dacae905cb9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.648663:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134582.648665:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134582.648667:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134582.648676:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787134582.648688:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311932672:0@lo:103: 00000100:00100000:3.0:1787134582.648724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.648758:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311932672 00000100:00100000:3.0:1787134582.648762:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311932672 00000100:00100000:3.0:1787134582.648801:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134582.648810:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3308:x1873946311932672:12345-0@lo:103: 00010000:00010000:3.0:1787134582.648823:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134582.648840:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59deba00/0x69932dacae905cb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905cb2 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.648856:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134582.648888:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:3308:x1873946311932672:12345-0@lo:103: Request processed in 79us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.648895:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134582.648932:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311932672:0@lo:103: 00000100:00100000:0.0:1787134582.648982:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787134582.648991:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+11:7614:x1873946311932544:12345-0@lo:101: 00010000:00010000:0.0:1787134582.649002:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134582.649019:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905cc0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.649061:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905cc0 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.649073:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905cc0 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.649080:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa40030400, rc 0) 00000100:00100000:0.0:1787134582.649122:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311932544:12345-0@lo:101: Request processed in 133us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.649127:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787134582.650926:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932544:0@lo:101: 00010000:00010000:3.0:1787134582.650987:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.651001:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.651211:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932800:0@lo:501: 00000100:00100000:3.0:1787134582.651287:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.651333:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7fc33840 going to sleep for 11 seconds 00000100:00100000:3.0:1787134582.651486:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311932800 00000100:00100000:3.0:1787134582.651494:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311932800 00000100:00100000:3.0:1787134582.651540:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787134582.651550:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311932800:12345-0@lo:501: 00000100:00100000:3.0:1787134582.651962:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311932800:12345-0@lo:501: Request processed in 411us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.651971:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787134582.652545:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932800:0@lo:501: 00000100:00100000:2.0:1787134582.653115:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932928:0@lo:503: 00000100:00100000:2.0:1787134582.653234:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134582.653276:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa42db29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134582.653422:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311932928 00000100:00100000:3.0:1787134582.653430:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311932928 00000100:00100000:3.0:1787134582.653472:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787134582.653481:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311932928:12345-0@lo:503: 00000100:00100000:3.0:1787134582.655067:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311932928:12345-0@lo:503: Request processed in 1573us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.655083:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787134582.657663:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134582.657700:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311933056:0@lo:400: 00000100:00100000:0.0:1787134582.657799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.657855:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311933184:0@lo:400: 00000100:00100000:0.0:1787134582.657893:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.657932:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134582.657945:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311933312:0@lo:400: 00000100:00100000:0.0:1787134582.657988:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.658046:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311933312 00000100:00100000:0.0:1787134582.658056:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311933312 00000100:00100000:0.0:1787134582.658130:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787134582.658141:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311933312:12345-0@lo:400: 00000100:00100000:0.0:1787134582.658240:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311933312:12345-0@lo:400: Request processed in 100us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.658249:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787134582.658273:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787134582.658325:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6ff80a80 x1873946311933312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134582.658362:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311933312:0@lo:400: 00000100:00100000:3.0:1787134582.659635:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311933056 00000100:00100000:3.0:1787134582.659649:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311933056 00000100:00100000:3.0:1787134582.659729:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311933184 00000100:00100000:3.0:1787134582.659751:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311933184 00000100:00100000:3.0:1787134582.659811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787134582.659828:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311933056:12345-0@lo:400: 00000100:00100000:3.0:1787134582.659944:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311933056:12345-0@lo:400: Request processed in 122us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.659956:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787134582.659987:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787134582.660000:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311933184:12345-0@lo:400: 00000100:00100000:3.0:1787134582.660081:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311933184:12345-0@lo:400: Request processed in 84us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.660088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787134582.660111:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787134582.660146:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6ff80e00 x1873946311933056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134582.660184:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311933056:0@lo:400: 00010000:00080000:3.0:1787134582.660225:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6ff81180 x1873946311933184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134582.660236:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311933184:0@lo:400: 00000100:00100000:2.0:1787134582.660353:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311932928:0@lo:503: 00000040:00080000:2.0:1787134582.660865:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787134582.660975:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933440:0@lo:502: 00000100:00100000:2.0:1787134582.661045:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134582.661106:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa42db29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134582.661316:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311933440 00000100:00100000:1.0:1787134582.661329:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311933440 00000100:00100000:1.0:1787134582.661460:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787134582.661478:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311933440:12345-0@lo:502: 00000100:00100000:1.0:1787134582.661779:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311933440:12345-0@lo:502: Request processed in 303us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134582.662306:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787134582.662400:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933440:0@lo:502: 00000040:00080000:1.0:1787134582.662780:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787134582.662850:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787134582.662885:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787134582.662946:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787134582.662985:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787134582.663049:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787134582.663109:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933568:0@lo:502: 00000100:00100000:1.0:1787134582.663217:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134582.663258:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.663554:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311933568 00000100:00100000:0.0:1787134582.663571:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311933568 00000100:00100000:0.0:1787134582.663639:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787134582.663650:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311933568:12345-0@lo:502: 00000100:00100000:0.0:1787134582.663969:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311933568:12345-0@lo:502: Request processed in 319us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.663978:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787134582.664843:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933568:0@lo:502: 00000040:00080000:3.0:1787134582.665049:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787134582.665067:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787134582.670474:0:7623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787134582.670493:0:7623:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787134582.670503:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134582.670505:0:7623:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787134582.670513:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787134582.670568:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98aa4334b380) 00000020:00000080:3.0:1787134582.670600:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787134582.670608:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787134582.670684:0:7623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa52a7d800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787134582.670694:0:7623:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787134582.670702:0:7623:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x69932dacae905cd5 00010000:00010000:1.0:1787134582.695597:0:7623:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787134582.695939:0:7623:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787134582.698111:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787134582.703883:0:7623:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787134582.714961:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787134582.716838:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787134582.723968:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787134582.723981:0:7623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134582.723989:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134582.723991:0:7623:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787134582.723996:0:7623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787134582.724000:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134582.724001:0:7623:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787134582.724005:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787134582.724006:0:7623:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787134582.724067:0:7623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134582.724070:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134582.724072:0:7623:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787134582.724075:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787134582.724288:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787134582.724324:0:7614:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787134582.724459:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.724473:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134582.724483:0:7614:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa52a7d800 from 1 10000000:01000000:1.0:1787134582.724486:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787134582.724527:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.724536:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.724549:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134582.724575:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933696:0@lo:101: 00000100:00100000:1.0:1787134582.724655:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134582.724714:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.729311:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311933696 00000100:00100000:0.0:1787134582.729327:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311933696 00000100:00100000:0.0:1787134582.729394:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787134582.729406:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:7614:x1873946311933696:12345-0@lo:101: 00010000:00010000:0.0:1787134582.729435:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134582.729455:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905cdc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.729506:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905cdc expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.729519:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905cdc expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.729529:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa40031400, rc 0) 00000100:00100000:0.0:1787134582.729609:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311933696:12345-0@lo:101: Request processed in 206us (4953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.729616:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787134582.730122:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933696:0@lo:101: 00010000:00010000:1.0:1787134582.730141:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134582.730152:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134582.730311:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933824:0@lo:501: 00000100:00100000:1.0:1787134582.730367:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134582.730398:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.732979:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311933824 00000100:00100000:0.0:1787134582.732999:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311933824 00000100:00100000:0.0:1787134582.733067:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787134582.733078:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311933824:12345-0@lo:501: 00000100:00100000:0.0:1787134582.733475:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311933824:12345-0@lo:501: Request processed in 398us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.733484:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787134582.733547:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933824:0@lo:501: 00000100:00100000:0.0:1787134582.733618:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933952:0@lo:503: 00000100:00100000:0.0:1787134582.733666:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.733688:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.733706:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311933952 00000100:00100000:0.0:1787134582.733710:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311933952 00000100:00100000:0.0:1787134582.733730:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787134582.733736:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311933952:12345-0@lo:503: 00000100:00100000:0.0:1787134582.734000:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311933952:12345-0@lo:503: Request processed in 263us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.734013:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787134582.734049:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311933952:0@lo:503: 00000040:00080000:0.0:1787134582.734392:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787134582.734462:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934080:0@lo:502: 00000100:00100000:0.0:1787134582.734496:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.734513:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.734527:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311934080 00000100:00100000:0.0:1787134582.734531:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311934080 00000100:00100000:0.0:1787134582.734548:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787134582.734553:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311934080:12345-0@lo:502: 00000100:00100000:0.0:1787134582.734700:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311934080:12345-0@lo:502: Request processed in 145us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.734706:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787134582.734743:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934080:0@lo:502: 00000040:00080000:0.0:1787134582.734967:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787134582.735013:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787134582.735033:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934208:0@lo:502: 00000100:00100000:0.0:1787134582.735064:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134582.735078:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.735091:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311934208 00000100:00100000:0.0:1787134582.735095:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311934208 00000100:00100000:0.0:1787134582.735111:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787134582.735117:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311934208:12345-0@lo:502: 00000100:00100000:0.0:1787134582.735246:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311934208:12345-0@lo:502: Request processed in 129us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.735253:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787134582.735292:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934208:0@lo:502: 00000040:00080000:0.0:1787134582.735356:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787134582.735366:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787134582.744106:0:7627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787134582.744121:0:7627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134582.744123:0:7627:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787134582.744132:0:7627:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa52a7d800 00000020:00000080:2.0:1787134582.744135:0:7627:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787134582.744182:0:7627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787134582.744186:0:7627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134582.744187:0:7627:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787134582.744191:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787134582.745438:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787134582.745486:0:7614:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787134582.745508:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.745521:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134582.745590:0:7614:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787134582.745593:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98aa52a7d800 10000000:01000000:3.0:1787134582.745596:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98aa52a7d800 10000000:01000000:3.0:1787134582.745600:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787134582.745605:0:7614:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa52a7d800 from 1 10000000:01000000:3.0:1787134582.745608:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787134582.745643:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.745651:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.745662:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.745687:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934336:0@lo:101: 00000100:00100000:3.0:1787134582.745751:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.745795:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7fc33300 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.745986:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311934336 00000100:00100000:0.0:1787134582.745994:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311934336 00000100:00100000:0.0:1787134582.746036:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787134582.746046:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311934336:12345-0@lo:101: 00010000:00010000:0.0:1787134582.746057:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134582.746070:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905cea expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.746093:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905cea expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.746105:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905cea expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134582.746114:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa40030600, rc 0) 00000100:00100000:0.0:1787134582.746153:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311934336:12345-0@lo:101: Request processed in 108us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.746179:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787134582.747420:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934336:0@lo:101: 00010000:00010000:3.0:1787134582.747442:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.747452:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.747571:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934464:0@lo:501: 00000100:00100000:3.0:1787134582.747636:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.747682:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7fc33300 going to sleep for 11 seconds 00000100:00100000:2.0:1787134582.747929:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311934464 00000100:00100000:2.0:1787134582.747936:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311934464 00000100:00100000:2.0:1787134582.747976:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787134582.747987:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311934464:12345-0@lo:501: 00000100:00100000:2.0:1787134582.748285:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311934464:12345-0@lo:501: Request processed in 285us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134582.748293:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787134582.751961:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934464:0@lo:501: 00000100:00100000:3.0:1787134582.752028:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934592:0@lo:503: 00000100:00100000:3.0:1787134582.752107:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.752148:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7fc33300 going to sleep for 11 seconds 00000100:00100000:2.0:1787134582.752538:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311934592 00000100:00100000:2.0:1787134582.752546:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311934592 00000100:00100000:2.0:1787134582.752599:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787134582.752607:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311934592:12345-0@lo:503: 00000100:00100000:2.0:1787134582.752811:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311934592:12345-0@lo:503: Request processed in 203us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134582.752820:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787134582.752913:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934592:0@lo:503: 00000040:00080000:3.0:1787134582.753410:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787134582.753489:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934720:0@lo:502: 00000100:00100000:3.0:1787134582.753535:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.753568:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7fc33300 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.753813:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311934720 00000100:00100000:0.0:1787134582.753818:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311934720 00000100:00100000:0.0:1787134582.753855:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787134582.753863:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311934720:12345-0@lo:502: 00000100:00100000:0.0:1787134582.754065:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311934720:12345-0@lo:502: Request processed in 203us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.754073:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787134582.754548:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934720:0@lo:502: 00000040:00080000:3.0:1787134582.754818:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787134582.754871:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787134582.754907:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787134582.754955:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787134582.755007:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787134582.755058:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787134582.755105:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787134582.755142:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787134582.759095:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787134582.759182:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787134582.759235:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787134582.759318:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787134582.759353:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787134582.759384:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787134582.759446:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787134582.759481:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787134582.759513:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787134582.759556:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787134582.759590:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787134582.759624:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787134582.759671:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787134582.759706:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787134582.759738:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787134582.759800:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787134582.759839:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787134582.759877:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787134582.759921:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787134582.759955:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787134582.759986:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787134582.760032:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787134582.760067:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787134582.760099:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787134582.760135:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787134582.760212:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787134582.760250:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787134582.760296:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787134582.760333:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787134582.760394:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934848:0@lo:502: 00000100:00100000:2.0:1787134582.760494:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134582.760539:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa44fbe540 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.760730:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311934848 00000100:00100000:0.0:1787134582.760738:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311934848 00000100:00100000:0.0:1787134582.760792:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787134582.760803:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311934848:12345-0@lo:502: 00000100:00100000:0.0:1787134582.761018:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311934848:12345-0@lo:502: Request processed in 216us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.761025:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787134582.762097:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311934848:0@lo:502: 00000040:00080000:3.0:1787134582.762498:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787134582.762520:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787134582.765886:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787134582.765904:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98aa43348000) 00000020:00000080:3.0:1787134582.765930:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787134582.766154:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa52a7d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787134582.766185:0:7628:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98aa52a7d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787134582.766197:0:7628:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa52a7d800 3 00010000:00080000:3.0:1787134582.766260:0:7628:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa6f898800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.136@tcp at head 00010000:00010000:2.0:1787134582.776922:0:7628:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787134582.777039:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787134582.777093:0:7628:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787134582.777110:0:7628:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x69932dacae905cff 00000100:00080000:2.0:1787134582.777121:0:7628:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787134582.777126:0:7628:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98aa6f898800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787134582.777186:0:7628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa6ff84e00 x1873946311934976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787134582.777209:0:7628:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1787134582.778108:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787134582.778310:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1873946311934976:0@lo:38: 00000100:00100000:1.0:1787134582.778385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787134582.778562:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787134582.778589:0:7614:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787134582.778606:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.778618:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787134582.778667:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787134582.778669:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787134582.778671:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134582.778672:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134582.778673:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134582.778675:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134582.778676:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787134582.778677:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787134582.778679:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787134582.778680:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134582.778682:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787134582.778686:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787134582.778688:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787134582.778690:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787134582.778691:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134582.778692:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134582.778693:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134582.778694:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134582.778695:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787134582.778696:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787134582.778697:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787134582.778703:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134582.778704:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787134582.778724:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787134582.778735:0:7614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311935104:0@lo:253: 00000100:00100000:2.0:1787134582.778772:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134582.778798:0:7614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4500ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.780295:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311934976 00000100:00100000:0.0:1787134582.780310:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311934976 00000100:00100000:0.0:1787134582.780365:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134582.780373:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1873946311934976:12345-0@lo:38: 00010000:00080000:0.0:1787134582.780401:0:5837:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1787134582.780449:0:5837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x69932dacae905d06 00000004:00100000:0.0:1787134582.780464:0:5837:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787134582.780495:0:5837:0:(import.c:65:import_set_state_nolock()) ffff98aa551b3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787134582.780586:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873946311934976:12345-0@lo:38: Request processed in 213us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.780594:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787134582.784859:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311935104 00000100:00100000:1.0:1787134582.784878:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311935104 00000100:00100000:1.0:1787134582.784958:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787134582.784970:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7614:x1873946311935104:12345-0@lo:253: 20000000:01000000:1.0:1787134582.785008:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787134582.785025:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787134582.785581:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6ff84e00 x1873946311934976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787134592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134582.785594:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787134582.785603:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787134582.785611:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787134582.785616:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787134582.785620:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa6f898800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787134582.785627:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1873946311934976:0@lo:38: 00000100:00100000:3.0:1787134582.785999:0:7630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1873946311935232:0@lo:901: 00000100:00100000:3.0:1787134582.786085:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.786140:0:7630:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7fc33c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134582.786434:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311935232 00000100:00100000:0.0:1787134582.786441:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311935232 00000100:00100000:0.0:1787134582.786492:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787134582.786500:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1873946311935232:12345-0@lo:901: 00000100:00100000:0.0:1787134582.786816:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1873946311935232:12345-0@lo:901: Request processed in 316us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134582.786824:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787134582.787146:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787134582.787205:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa73cc7100 x1873946311935232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787134598 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134582.787218:0:7630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1873946311935232:0@lo:901: 20000000:01000000:3.0:1787134582.878997:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787134582.879511:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787134582.879549:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787134582.879557:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787134582.879593:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.879618:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c57 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.879627:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.879686:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905c57 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134582.879708:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905c57 expref: 14 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134582.879727:0:5851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1873946311935360:0@lo:104: 00000100:00100000:2.0:1787134582.879840:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134582.879923:0:5851:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4629d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787134582.880849:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311935360 00000100:00100000:3.0:1787134582.880862:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311935360 00000100:00100000:3.0:1787134582.880949:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787134582.880961:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5851:x1873946311935360:12345-0@lo:104: 00010000:00010000:3.0:1787134582.880985:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.881092:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787134582.881118:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:5851:x1873946311935360:12345-0@lo:104: Request processed in 160us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.881126:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787134582.881142:0:5851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1873946311935360:0@lo:104: 00010000:00010000:0.0:1787134582.881214:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.881430:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134582.881440:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.881448:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa821c5000 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134582.881454:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.881463:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134582.881472:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134582.881478:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787134582.881717:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.881725:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134582.881760:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.881768:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa821c5000/0x69932dacae905c57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.881791:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134582.881793:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134582.881795:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134582.881814:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787134582.881834:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311935488:0@lo:103: 00000100:00100000:3.0:1787134582.881894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134582.882113:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311935488 00000100:00100000:3.0:1787134582.882120:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311935488 00010000:00010000:3.0:1787134582.882152:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c57 expref: 15 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134582.884687:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787134582.884718:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa47fac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:3308:x1873946311935488:12345-0@lo:103: 00010000:00010000:3.0:1787134582.884751:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134582.884764:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c57 expref: 15 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.884784:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905c57 expref: 15 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.884809:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa821c4800/0x69932dacae905c5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905c57 expref: 15 pid: 5828 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.884831:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.884841:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787134582.884868:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005312260s 00010000:00010000:3.0:1787134582.884874:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.884882:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.888483:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.888885:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.888896:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fd800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134582.888902:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.889205:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.889322:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.889347:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134582.889479:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa47fac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:3308:x1873946311935488:12345-0@lo:103: Request processed in 4774us (7578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134582.889493:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787134582.889636:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311935488:0@lo:103: 00010000:00010000:3.0:1787134582.889671:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.889680:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134582.889687:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa413fd800/0x69932dacae905d0d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134582.930996:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:7614:x1873946311935104:12345-0@lo:253: Request processed in 146015us (152209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134582.931018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787134582.931343:0:7614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7614:1873946311935104:0@lo:253: 10000000:01000000:0.0:1787134582.931375:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787134582.931379:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787134582.931382:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787134582.931383:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134582.931384:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134582.931386:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134582.931388:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134582.931390:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787134582.931391:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787134582.931393:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787134582.931396:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134582.931397:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787134582.931426:0:7614:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787134582.948683:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787134582.948901:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787134582.949153:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787134582.950694:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787134582.951335:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787134582.951585:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787134582.967279:0:7614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787134583.173916:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134583.173958:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311935616:0@lo:13: 00000100:00100000:0.0:1787134583.179271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134583.179399:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311935616 00000100:00100000:0.0:1787134583.179419:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311935616 00000100:00100000:0.0:1787134583.179495:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134583.179507:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311935616:12345-0@lo:13: 00002000:00000024:0.0:1787134583.179554:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134583.179604:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311935616:12345-0@lo:13: Request processed in 100us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134583.179612:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787134583.179657:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa6aa8c000 x1873946311935616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134583.179680:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311935616:0@lo:13: 00010000:00010000:2.0:1787134583.238852:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787134583.394493:0:7614:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787134583.394505:0:7614:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787134583.394560:0:7614:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787134583.394657:0:7614:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787134583.394677:0:7614:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787134583.394706:0:7614:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787134584.258462:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134585.281327:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134586.313486:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134587.333195:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134588.294122:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311936000:0@lo:400: 00000100:00100000:0.0:1787134588.294245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134588.294464:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311936128:0@lo:400: 00000100:00100000:1.0:1787134588.294503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134588.294543:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311936128 00000100:00100000:1.0:1787134588.294553:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311936128 00000100:00100000:1.0:1787134588.294629:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787134588.294641:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311936128:12345-0@lo:400: 00000100:00100000:1.0:1787134588.294725:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311936128:12345-0@lo:400: Request processed in 87us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134588.294734:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787134588.294760:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787134588.294797:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311936000 00000100:00100000:1.0:1787134588.294801:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311936000 00000100:00100000:3.0:1787134588.294947:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311935744:0@lo:400: 00000100:00100000:3.0:1787134588.294992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134588.295023:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311935872:0@lo:400: 00000100:00100000:3.0:1787134588.295052:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787134588.295129:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134588.296852:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311935872 00000100:00100000:1.0:1787134588.296871:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311935872 00000100:00100000:2.0:1787134588.297020:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787134588.297039:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311936000:12345-0@lo:400: 00000100:00100000:2.0:1787134588.297180:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311936000:12345-0@lo:400: Request processed in 148us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134588.297189:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787134588.297593:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787134588.297602:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311935872:12345-0@lo:400: 00000100:00100000:1.0:1787134588.297660:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311935872:12345-0@lo:400: Request processed in 59us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134588.297667:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787134588.297762:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff81c00 x1873946311936000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134588.297780:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311936000:0@lo:400: 00000100:00100000:3.0:1787134588.298585:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311935744 00000100:00100000:3.0:1787134588.298597:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311935744 00000100:00100000:3.0:1787134588.298730:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787134588.298742:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3309:x1873946311935744:12345-0@lo:400: 00000100:00100000:3.0:1787134588.298832:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:3309:x1873946311935744:12345-0@lo:400: Request processed in 93us (3838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134588.298840:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1787134588.299022:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff81180 x1873946311936128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134588.299040:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311936128:0@lo:400: 00000100:00100000:1.0:1787134588.299760:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311935744:0@lo:400: 00000100:00100000:1.0:1787134588.299778:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311936256:0@lo:400: 00000100:00100000:1.0:1787134588.299840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787134588.300055:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff83480 x1873946311935872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134588.300066:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311935872:0@lo:400: 00000100:00100000:3.0:1787134588.300073:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311936384:0@lo:13: 00000100:00100000:3.0:1787134588.300104:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134588.300425:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311936384 00000100:00100000:2.0:1787134588.300432:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311936384 00000100:00100000:2.0:1787134588.300562:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787134588.300573:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311936384:12345-0@lo:13: 00002000:00000024:2.0:1787134588.300622:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134588.300689:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311936384:12345-0@lo:13: Request processed in 117us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134588.300697:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787134588.300820:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6aa8c000 x1873946311936384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134588.300837:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311936384:0@lo:13: 00000100:00100000:0.0:1787134588.301123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311936256 00000100:00100000:0.0:1787134588.301130:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311936256 00000100:00100000:0.0:1787134588.301250:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787134588.301260:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311936256:12345-0@lo:400: 00000100:00100000:0.0:1787134588.301327:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311936256:12345-0@lo:400: Request processed in 68us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134588.301334:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787134588.301493:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff80e00 x1873946311936256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134588.301506:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311936256:0@lo:400: 00000100:00080000:1.0:1787134588.301670:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787134588.358986:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134589.377129:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787134589.824506:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787134589.824518:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa438c0800 from 30 10000000:01000000:2.0:1787134589.824536:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787134589.824616:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134589.824630:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134589.824646:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134589.824682:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311936512:0@lo:101: 00000100:00100000:2.0:1787134589.824801:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134589.824890:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa48038540 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.825080:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311936512 00000100:00100000:3.0:1787134589.825091:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311936512 00000100:00100000:3.0:1787134589.825201:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787134589.825215:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311936512:12345-0@lo:101: 00010000:00010000:3.0:1787134589.825247:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134589.825268:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905d14 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.825581:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905d14 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.825599:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d14 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.825613:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a600, rc 0) 00000100:00100000:3.0:1787134589.825687:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311936512:12345-0@lo:101: Request processed in 475us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.825695:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787134589.826450:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311936512:0@lo:101: 00010000:00010000:0.0:1787134589.826477:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.826489:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134589.828034:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311936640:0@lo:501: 00000100:00100000:0.0:1787134589.828145:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.828239:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787134589.834798:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311936640 00000100:00100000:2.0:1787134589.834823:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311936640 00000100:00100000:2.0:1787134589.834911:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787134589.834923:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311936640:12345-0@lo:501: 00000100:00100000:2.0:1787134589.835678:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311936640:12345-0@lo:501: Request processed in 754us (7541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134589.835688:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787134589.838094:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311936640:0@lo:501: 00000100:00100000:0.0:1787134589.838276:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311936768:0@lo:503: 00000100:00100000:0.0:1787134589.838408:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.838468:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.838643:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311936768 00000100:00100000:3.0:1787134589.838654:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311936768 00000100:00100000:3.0:1787134589.838730:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787134589.838751:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311936768:12345-0@lo:503: 00000100:00100000:3.0:1787134589.839321:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311936768:12345-0@lo:503: Request processed in 572us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.839330:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787134589.839417:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311936768:0@lo:503: 00000100:00100000:3.0:1787134589.839684:0:7833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7833:1873946311936896:0@lo:502: 00000100:00100000:3.0:1787134589.839734:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.839765:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311936896 00000100:00100000:3.0:1787134589.839770:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311936896 00000100:00100000:3.0:1787134589.839803:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787134589.839811:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7833:x1873946311936896:12345-0@lo:502: 00000100:00100000:3.0:1787134589.840062:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7833:x1873946311936896:12345-0@lo:502: Request processed in 251us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.840070:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787134589.840108:0:7833:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa814296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.840122:0:7833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7833:1873946311936896:0@lo:502: 00000100:00100000:3.0:1787134589.840203:0:7833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7833:1873946311937024:0@lo:502: 00000100:00100000:3.0:1787134589.840239:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.840261:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311937024 00000100:00100000:3.0:1787134589.840265:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311937024 00000100:00100000:3.0:1787134589.840286:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787134589.840292:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7833:x1873946311937024:12345-0@lo:502: 00000100:00100000:3.0:1787134589.840431:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:7833:x1873946311937024:12345-0@lo:502: Request processed in 138us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.840438:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787134589.840468:0:7833:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa814296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.840480:0:7833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7833:1873946311937024:0@lo:502: 00000040:00080000:3.0:1787134589.840500:0:7833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787134589.840571:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787134589.840600:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787134589.840612:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.840626:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134589.840639:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787134589.840643:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787134589.840646:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787134589.840679:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.840689:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.840699:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134589.840712:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937152:0@lo:101: 00000100:00100000:3.0:1787134589.840741:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.840756:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa551bb000 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.840771:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311937152 00000100:00100000:3.0:1787134589.840775:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311937152 00000100:00100000:3.0:1787134589.840795:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787134589.840802:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311937152:12345-0@lo:101: 00010000:00010000:3.0:1787134589.840816:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134589.840833:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905d22 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.840860:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905d22 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.840875:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d22 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.840886:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7aa00, rc 0) 00000100:00100000:3.0:1787134589.840924:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311937152:12345-0@lo:101: Request processed in 122us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.840929:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787134589.840962:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937152:0@lo:101: 00010000:00010000:3.0:1787134589.840976:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.840987:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134589.841028:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937280:0@lo:501: 00000100:00100000:3.0:1787134589.841053:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.841066:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa551bb000 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.841078:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311937280 00000100:00100000:3.0:1787134589.841081:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311937280 00000100:00100000:3.0:1787134589.841100:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787134589.841106:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311937280:12345-0@lo:501: 00000100:00100000:3.0:1787134589.841425:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311937280:12345-0@lo:501: Request processed in 317us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.841432:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787134589.841461:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937280:0@lo:501: 00000100:00100000:3.0:1787134589.841489:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937408:0@lo:503: 00000100:00100000:3.0:1787134589.841529:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.841544:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa551bb000 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.841558:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311937408 00000100:00100000:3.0:1787134589.841562:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311937408 00000100:00100000:3.0:1787134589.852284:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787134589.852303:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311937408:12345-0@lo:503: 00000100:00100000:3.0:1787134589.852883:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311937408:12345-0@lo:503: Request processed in 583us (11350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.852894:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787134589.852970:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937408:0@lo:503: 00000100:00100000:3.0:1787134589.853287:0:7834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7834:1873946311937536:0@lo:502: 00000100:00100000:3.0:1787134589.853345:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.853396:0:7834:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa58dbd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134589.853798:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311937536 00000100:00100000:0.0:1787134589.853809:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311937536 00000100:00100000:0.0:1787134589.853864:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787134589.853875:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:7834:x1873946311937536:12345-0@lo:502: 00000100:00100000:0.0:1787134589.854208:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:7834:x1873946311937536:12345-0@lo:502: Request processed in 331us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.854218:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787134589.854460:0:7834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7834:1873946311937536:0@lo:502: 00000020:01000000:3.0:1787134589.854495:0:7834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134589.854507:0:7834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134589.854510:0:7834:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787134589.854517:0:7834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787134589.854519:0:7834:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787134589.854854:0:7834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7834:1873946311937664:0@lo:502: 00000100:00100000:3.0:1787134589.854918:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.854950:0:7834:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134589.855111:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311937664 00000100:00100000:0.0:1787134589.855118:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311937664 00000100:00100000:0.0:1787134589.855219:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787134589.855451:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:7834:x1873946311937664:12345-0@lo:502: 00000100:00100000:0.0:1787134589.855712:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:7834:x1873946311937664:12345-0@lo:502: Request processed in 483us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.855721:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787134589.855826:0:7834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7834:1873946311937664:0@lo:502: 00000020:01000000:1.0:1787134589.855860:0:7834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134589.855869:0:7834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134589.855872:0:7834:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787134589.855878:0:7834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787134589.856466:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787134589.856489:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787134589.856503:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.856516:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134589.856539:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787134589.856543:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa4da38000 from 30 10000000:01000000:0.0:1787134589.856546:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787134589.856602:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.856611:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.856622:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134589.856643:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937792:0@lo:101: 00000100:00100000:0.0:1787134589.856705:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.856758:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.856884:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311937792 00000100:00100000:3.0:1787134589.856894:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311937792 00000100:00100000:3.0:1787134589.856948:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787134589.856958:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311937792:12345-0@lo:101: 00010000:00010000:3.0:1787134589.856971:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134589.856989:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905d30 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.857020:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905d30 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.857032:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d30 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.857042:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a800, rc 0) 00000100:00100000:3.0:1787134589.857090:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311937792:12345-0@lo:101: Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.857098:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787134589.857557:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937792:0@lo:101: 00010000:00010000:0.0:1787134589.857579:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.857592:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134589.857670:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937920:0@lo:501: 00000100:00100000:0.0:1787134589.857719:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.857762:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.857883:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311937920 00000100:00100000:3.0:1787134589.857890:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311937920 00000100:00100000:3.0:1787134589.857931:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787134589.857940:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311937920:12345-0@lo:501: 00000100:00100000:3.0:1787134589.858628:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311937920:12345-0@lo:501: Request processed in 686us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.858638:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787134589.858724:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311937920:0@lo:501: 00000100:00100000:1.0:1787134589.858785:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938048:0@lo:503: 00000100:00100000:1.0:1787134589.858828:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134589.858863:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134589.859000:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311938048 00000100:00100000:0.0:1787134589.859006:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311938048 00000100:00100000:0.0:1787134589.859113:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787134589.859123:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311938048:12345-0@lo:503: 00000100:00100000:0.0:1787134589.859389:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311938048:12345-0@lo:503: Request processed in 267us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.859397:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787134589.862834:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938048:0@lo:503: 00000100:00100000:3.0:1787134589.866379:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7835:1873946311938176:0@lo:502: 00000100:00100000:3.0:1787134589.866509:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.866664:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787134589.869692:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311938176 00000100:00100000:0.0:1787134589.869716:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311938176 00000100:00100000:0.0:1787134589.869809:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787134589.869822:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:7835:x1873946311938176:12345-0@lo:502: 00000100:00100000:0.0:1787134589.870632:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:7835:x1873946311938176:12345-0@lo:502: Request processed in 809us (4119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.870644:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787134589.871453:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7835:1873946311938176:0@lo:502: 00000100:00100000:3.0:1787134589.871580:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7835:1873946311938304:0@lo:502: 00000100:00100000:3.0:1787134589.871656:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.871684:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787134589.871894:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311938304 00000100:00100000:0.0:1787134589.871901:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311938304 00000100:00100000:0.0:1787134589.871960:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787134589.871970:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:7835:x1873946311938304:12345-0@lo:502: 00000100:00100000:0.0:1787134589.872317:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:7835:x1873946311938304:12345-0@lo:502: Request processed in 348us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.872326:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787134589.873393:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7835:1873946311938304:0@lo:502: 00000040:00080000:3.0:1787134589.873439:0:7835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787134589.873778:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787134589.873810:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787134589.873823:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.873837:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134589.873849:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787134589.873852:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98aa4da38000 from 5 10000000:01000000:0.0:1787134589.873855:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787134589.873908:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.873917:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.873939:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134589.873963:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938432:0@lo:101: 00000100:00100000:0.0:1787134589.874034:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.874124:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.877748:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311938432 00000100:00100000:3.0:1787134589.877777:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311938432 00000100:00100000:3.0:1787134589.877875:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787134589.877887:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311938432:12345-0@lo:101: 00010000:00010000:3.0:1787134589.877912:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134589.877941:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7b600/0x69932dacae905d45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905d3e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.877980:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7b600/0x69932dacae905d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905d3e expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.877995:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7b600/0x69932dacae905d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d3e expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.878009:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b600, rc 0) 00000100:00100000:3.0:1787134589.878131:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311938432:12345-0@lo:101: Request processed in 246us (4096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.878383:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938432:0@lo:101: 00010000:00010000:0.0:1787134589.878412:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.878424:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134589.878520:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938560:0@lo:256: 00000100:00100000:0.0:1787134589.878595:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.878639:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787134589.878658:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311938560 00000100:00100000:0.0:1787134589.878663:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311938560 00000100:00100000:0.0:1787134589.878690:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787134589.878698:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311938560:12345-0@lo:256: 20000000:01000000:0.0:1787134589.878719:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787134589.878741:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787134589.878745:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787134589.878843:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311938560:12345-0@lo:256: Request processed in 145us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.878851:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787134589.878903:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938560:0@lo:256: 10000000:01000000:0.0:1787134589.878957:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787134589.878966:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.878976:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134589.878987:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787134589.878990:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787134589.878993:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787134589.879023:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.879032:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.879042:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134589.879057:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938688:0@lo:101: 00000100:00100000:0.0:1787134589.879085:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.879099:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787134589.879110:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311938688 00000100:00100000:0.0:1787134589.879113:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311938688 00000100:00100000:0.0:1787134589.879130:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787134589.879150:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311938688:12345-0@lo:101: 00010000:00010000:0.0:1787134589.879183:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134589.879196:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905d4c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.879220:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905d4c expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.879230:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d4c expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.879238:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa40031800, rc 0) 00000100:00100000:0.0:1787134589.879268:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311938688:12345-0@lo:101: Request processed in 132us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.879273:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787134589.879301:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938688:0@lo:101: 00010000:00010000:0.0:1787134589.879312:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134589.879320:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134589.879384:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938816:0@lo:501: 00000100:00100000:0.0:1787134589.879411:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.879424:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787134589.879435:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311938816 00000100:00100000:0.0:1787134589.879439:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311938816 00000100:00100000:0.0:1787134589.879456:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787134589.879461:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311938816:12345-0@lo:501: 00000100:00100000:0.0:1787134589.879820:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311938816:12345-0@lo:501: Request processed in 356us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.879827:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787134589.879867:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938816:0@lo:501: 00000100:00100000:0.0:1787134589.879899:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938944:0@lo:503: 00000100:00100000:0.0:1787134589.879945:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.879958:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787134589.879971:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311938944 00000100:00100000:0.0:1787134589.879975:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311938944 00000100:00100000:0.0:1787134589.879993:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787134589.880000:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311938944:12345-0@lo:503: 00000100:00100000:0.0:1787134589.880373:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311938944:12345-0@lo:503: Request processed in 372us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.880381:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787134589.880421:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311938944:0@lo:503: 00000100:00100000:3.0:1787134589.880854:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787134589.890674:0:7836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7836:1873946311939072:0@lo:502: 00000100:00100000:0.0:1787134589.890826:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134589.890973:0:7836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787134589.899686:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311939072 00000100:00100000:1.0:1787134589.899710:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311939072 00000100:00100000:1.0:1787134589.899846:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787134589.899860:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:7836:x1873946311939072:12345-0@lo:502: 00000100:00100000:1.0:1787134589.900457:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:7836:x1873946311939072:12345-0@lo:502: Request processed in 597us (9628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134589.900466:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787134589.902505:0:7836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7836:1873946311939072:0@lo:502: 00000020:01000000:0.0:1787134589.902568:0:7836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787134589.902581:0:7836:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787134589.902595:0:7836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134589.902598:0:7836:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787134589.902604:0:7836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787134589.902609:0:7836:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.136@tcp to nid 0x20000c0a8ca88 (192.168.202.136@tcp) 00000020:01000000:0.0:1787134589.902646:0:7836:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787134589.902650:0:7836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787134589.902691:0:7836:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98aa81478000) 00000020:00000080:0.0:1787134589.902728:0:7836:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787134589.902742:0:7836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787134589.902864:0:7836:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787134589.902872:0:7836:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787134589.902881:0:7836:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae905d61 00010000:00080000:0.0:1787134589.902930:0:7836:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa7f76a000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:0.0:1787134589.903282:0:7836:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787134589.903734:0:7836:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787134589.903754:0:7836:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787134589.904440:0:7836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787134589.904673:0:7836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787134589.904732:0:7836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787134589.904799:0:7836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787134589.911962:0:7837:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787134589.911983:0:7837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787134589.915425:0:7836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787134589.915452:0:7836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787134589.915509:0:7836:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787134589.915628:0:7836:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae905d68 00000100:00080000:3.0:1787134589.915645:0:7836:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787134589.915653:0:7836:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98aa7f76a000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787134589.915707:0:7836:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa73cc5880 x1873946311939200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787134589.915816:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946311939200:0@lo:8: 00000100:00100000:1.0:1787134589.915920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787134589.916010:0:7836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787134589.916084:0:7836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134589.916089:0:7836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134589.916091:0:7836:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787134589.916094:0:7836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134589.916100:0:7836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134589.916101:0:7836:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787134589.916104:0:7836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787134589.916106:0:7836:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787134589.916811:0:7836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7836:1873946311939328:0@lo:502: 00000100:00100000:3.0:1787134589.916899:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.916938:0:7836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134589.917047:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311939328 00000100:00100000:1.0:1787134589.917057:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311939328 00000100:00100000:1.0:1787134589.917120:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787134589.917132:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:7836:x1873946311939328:12345-0@lo:502: 00000100:00100000:0.0:1787134589.917366:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311939200 00000100:00100000:0.0:1787134589.917372:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311939200 00000100:00100000:0.0:1787134589.917403:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134589.917410:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1873946311939200:12345-0@lo:8: 00010000:00080000:0.0:1787134589.917447:0:6680:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1787134589.917491:0:6680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae905d6f 00002000:00100000:0.0:1787134589.917511:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98aa7f76c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211390b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787134589.917516:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787134589.918634:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787134589.918808:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787134589.919017:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787134589.919061:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98aa7f768800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787134589.919501:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311939712:0@lo:400: 00000100:00100000:1.0:1787134589.920949:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:7836:x1873946311939328:12345-0@lo:502: Request processed in 3809us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134589.920967:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787134589.921062:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311939456:0@lo:400: 00000100:00100000:1.0:1787134589.921106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134589.921187:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787134589.921196:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311939584:0@lo:400: 00000100:00100000:1.0:1787134589.921222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134589.921289:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311939456 00000100:00100000:1.0:1787134589.921300:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311939456 00000100:00100000:1.0:1787134589.921374:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311939584 00000100:00100000:1.0:1787134589.921378:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311939584 00000100:00100000:1.0:1787134589.921398:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787134589.921406:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311939456:12345-0@lo:400: 00000100:00100000:1.0:1787134589.921466:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311939456:12345-0@lo:400: Request processed in 60us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134589.921473:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787134589.921485:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787134589.921492:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311939584:12345-0@lo:400: 00000100:00100000:1.0:1787134589.921519:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311939584:12345-0@lo:400: Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134589.925895:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787134589.926022:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa73cc7800 x1873946311939584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134589.926041:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311939584:0@lo:400: 00010000:00080000:1.0:1787134589.926057:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa73cc6300 x1873946311939456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134589.926065:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311939456:0@lo:400: 00000100:00100000:1.0:1787134589.927391:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311939840:0@lo:400: 00000100:00100000:1.0:1787134589.927503:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.927809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.927868:0:6681:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787134589.927879:0:6681:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787134589.928119:0:7836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:7836:1873946311939328:0@lo:502: 00000020:01000000:3.0:1787134589.928206:0:7836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134589.928216:0:7836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134589.928219:0:7836:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787134589.928718:0:7836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787134589.929022:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787134589.929048:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787134589.929064:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134589.929096:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134589.929109:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787134589.929113:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98aa6aa4b380 from 1 10000000:01000000:1.0:1787134589.929116:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787134589.929207:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134589.929217:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134589.929380:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134589.929411:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311939968:0@lo:101: 00000100:00100000:1.0:1787134589.929488:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134589.929614:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb000 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.929741:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311939968 00000100:00100000:3.0:1787134589.929751:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311939968 00000100:00100000:3.0:1787134589.929811:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787134589.929823:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311939968:12345-0@lo:101: 00010000:00010000:3.0:1787134589.929843:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134589.929861:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905d76 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.929892:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905d76 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.929905:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d76 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.929915:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b000, rc 0) 00000100:00100000:3.0:1787134589.929967:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311939968:12345-0@lo:101: Request processed in 147us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134589.929975:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787134589.930050:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311939968:0@lo:101: 00010000:00010000:3.0:1787134589.930066:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.930077:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134589.930175:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311940096:0@lo:501: 00000100:00100000:3.0:1787134589.930211:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134589.930228:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787134589.930399:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311940096 00000100:00100000:3.0:1787134589.930405:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311940096 00000100:00100000:3.0:1787134589.930431:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787134589.930439:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311940096:12345-0@lo:501: 00000100:00100000:3.0:1787134589.930889:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311940096:12345-0@lo:501: Request processed in 449us (676us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787134589.930898:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787134589.930942:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311940096:0@lo:501: 10000000:01000000:3.0:1787134589.930975:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787134589.930984:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134589.930992:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134589.931101:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1873946311939200:12345-0@lo:8: Request processed in 13688us (15177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.931113:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134589.931132:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311939712 00000100:00100000:0.0:1787134589.931147:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311939712 00000100:00100000:0.0:1787134589.931212:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134589.931219:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311939712:12345-0@lo:400: 00000100:00100000:0.0:1787134589.931281:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311939712:12345-0@lo:400: Request processed in 62us (3472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.931288:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134589.931309:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311939840 00000100:00100000:0.0:1787134589.931314:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311939840 00000100:00100000:0.0:1787134589.931354:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787134589.931363:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311939840:12345-0@lo:400: 00000100:00100000:0.0:1787134589.931405:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311939840:12345-0@lo:400: Request processed in 43us (3902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134589.931412:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787134589.931476:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa73cc7480 x1873946311939840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134589.931491:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311939840:0@lo:400: 00010000:00080000:0.0:1787134589.931741:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa73cc5880 x1873946311939200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787134599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134589.931751:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787134589.931761:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787134589.931770:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787134589.931777:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787134589.931781:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa7f76a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787134589.931795:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787134589.931802:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946311939200:0@lo:8: 00010000:00080000:3.0:1787134589.932368:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa73cc6680 x1873946311939712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134589.932381:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311939712:0@lo:400: 00000004:00080000:3.0:1787134589.932409:0:7837:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787134589.935470:0:7837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 205902307565ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787134590.034720:0:7838:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787134590.034816:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1873946311940352:0@lo:7: 00000100:00100000:0.0:1787134590.034911:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134590.034983:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81429c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134590.035013:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311940224:0@lo:13: 00000100:00100000:0.0:1787134590.035042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134590.035088:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311940352 00000100:00100000:0.0:1787134590.035098:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311940352 00000100:00100000:0.0:1787134590.035197:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787134590.035208:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7838:x1873946311940352:12345-0@lo:7: 00000100:00100000:2.0:1787134590.038038:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311940224 00000100:00100000:2.0:1787134590.038058:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311940224 00000100:00100000:2.0:1787134590.038141:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787134590.038154:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946311940224:12345-0@lo:13: 00002000:00000024:2.0:1787134590.038224:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787134590.038341:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946311940224:12345-0@lo:13: Request processed in 190us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134590.038362:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787134590.038472:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff80e00 x1873946311940224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134590.038497:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311940224:0@lo:13: 00000100:00080000:1.0:1787134590.039288:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787134590.040991:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1787134590.056860:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787134590.056874:0:6680:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787134590.057014:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7838:x1873946311940352:12345-0@lo:7: Request processed in 21800us (22096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134590.057028:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787134590.058451:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff80000 x1873946311940352/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787134606 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134590.058474:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1873946311940352:0@lo:7: 00000004:00080000:1.0:1787134590.058493:0:7838:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787134590.058697:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1873946311940480:0@lo:5: 00000100:00100000:1.0:1787134590.058775:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134590.058857:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81454300 going to sleep for 11 seconds 00000100:00100000:0.0:1787134590.059228:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311940480 00000100:00100000:0.0:1787134590.059370:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311940480 00000100:00100000:0.0:1787134590.059475:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787134590.059486:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7838:x1873946311940480:12345-0@lo:5: 00002000:00080000:0.0:1787134590.059534:0:6681:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787134590.059540:0:6681:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787134590.060118:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7838:x1873946311940480:12345-0@lo:5: Request processed in 631us (1340us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787134590.060128:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787134590.060256:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6aa8ed80 x1873946311940480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787134606 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134590.060279:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1873946311940480:0@lo:5: 00000004:00080000:0.0:1787134590.060304:0:7838:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787134590.060378:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1873946311940608:0@lo:700: 00000100:00100000:0.0:1787134590.060419:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134590.060441:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81429180 going to sleep for 11 seconds 00000100:00100000:3.0:1787134590.062448:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311940608 00000100:00100000:3.0:1787134590.062464:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311940608 00000100:00100000:3.0:1787134590.062904:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134590.062923:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7838:x1873946311940608:12345-0@lo:700: 00000100:00100000:3.0:1787134590.063001:0:6689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1873946311940736:0@lo:700: 00000100:00100000:3.0:1787134590.063087:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134590.063129:0:6689:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787134590.064039:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311940736 00000100:00100000:0.0:1787134590.064055:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311940736 00000100:00100000:0.0:1787134590.064144:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787134590.064202:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1873946311940736:12345-0@lo:700: 00000100:00080000:2.0:1787134590.064556:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:0.0:1787134590.204363:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787134590.216227:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1873946311940736:12345-0@lo:700: Request processed in 152059us (153125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134590.216263:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787134590.216615:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa73cc6680 x1873946311940736/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787134606 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134590.216635:0:6689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1873946311940736:0@lo:700: 40000000:02000000:0.0:1787134590.216656:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:0.0:1787134590.405636:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787134590.525412:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787134590.525440:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787134590.526542:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7838:x1873946311940608:12345-0@lo:700: Request processed in 463616us (466111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134590.526572:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787134590.526688:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff80000 x1873946311940608/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787134606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134590.526703:0:7838:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787134590.526726:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1873946311940608:0@lo:700: 00000004:02000040:1.0:1787134590.646748:0:7838:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787134590.656837:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1873946311940864:0@lo:5: 00000100:00100000:1.0:1787134590.656939:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134590.657016:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134590.657759:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311940864 00000100:00100000:0.0:1787134590.657772:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311940864 00000100:00100000:0.0:1787134590.658507:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787134590.658525:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7838:x1873946311940864:12345-0@lo:5: 00002000:00080000:3.0:1787134590.684811:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787134590.684856:0:6682:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787134590.696833:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7838:x1873946311940864:12345-0@lo:5: Request processed in 38301us (39881us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787134590.696851:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787134590.697039:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6aa8ed80 x1873946311940864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787134606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134590.697061:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1873946311940864:0@lo:5: 00000004:00080000:1.0:1787134590.697081:0:7838:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787134591.431058:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134592.448532:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787134593.225050:0:7980:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787134593.417489:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787134593.417526:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311940992:0@lo:13: 00000100:00100000:2.0:1787134593.417596:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134593.417768:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311940992 00000100:00100000:1.0:1787134593.417779:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311940992 00000100:00100000:1.0:1787134593.417867:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787134593.417879:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311940992:12345-0@lo:13: 00002000:00000024:1.0:1787134593.417939:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134593.417999:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311940992:12345-0@lo:13: Request processed in 123us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134593.418007:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787134593.418141:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787134593.418311:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6aa8c000 x1873946311940992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134593.418343:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311940992:0@lo:13: 00010000:00010000:1.0:1787134593.473328:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134594.500677:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134594.948792:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311941248:0@lo:400: 00000100:00100000:0.0:1787134594.948902:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134594.948972:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311941760:0@lo:400: 00000100:00100000:0.0:1787134594.949000:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134594.949036:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787134594.949042:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311941120:0@lo:400: 00000100:00100000:0.0:1787134594.949076:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134594.949106:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311941632:0@lo:400: 00000100:00100000:0.0:1787134594.949128:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134594.949183:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311941376:0@lo:400: 00000100:00100000:0.0:1787134594.949210:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134594.949229:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134594.949235:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311941504:0@lo:400: 00000100:00100000:0.0:1787134594.949257:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134594.949293:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311941248 00000100:00100000:0.0:1787134594.949313:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311941248 00000100:00100000:0.0:1787134594.949361:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311941632 00000100:00100000:0.0:1787134594.949365:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311941632 00000100:00100000:0.0:1787134594.949393:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311941376 00000100:00100000:0.0:1787134594.949396:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311941376 00000100:00100000:0.0:1787134594.949414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787134594.949423:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311941248:12345-0@lo:400: 00000100:00100000:0.0:1787134594.949485:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311941248:12345-0@lo:400: Request processed in 62us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134594.949493:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787134594.950031:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787134594.950041:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311941632:12345-0@lo:400: 00000100:00100000:0.0:1787134594.950089:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311941632:12345-0@lo:400: Request processed in 50us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134594.950103:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787134594.950117:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787134594.950123:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311941376:12345-0@lo:400: 00000100:00100000:0.0:1787134594.950195:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311941376:12345-0@lo:400: Request processed in 72us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134594.950202:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787134594.950224:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311941760 00000100:00100000:0.0:1787134594.950229:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311941760 00000100:00100000:0.0:1787134594.950261:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311941504 00000100:00100000:0.0:1787134594.950264:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311941504 00000100:00100000:0.0:1787134594.950282:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787134594.950288:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1873946311941760:12345-0@lo:400: 00000100:00100000:0.0:1787134594.950337:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1873946311941760:12345-0@lo:400: Request processed in 49us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134594.950343:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787134594.950351:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787134594.950356:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311941504:12345-0@lo:400: 00000100:00100000:0.0:1787134594.950381:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311941504:12345-0@lo:400: Request processed in 25us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134594.950386:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787134594.950406:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134594.950411:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787134594.950446:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa743a4000 x1873946311941632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134594.950462:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311941632:0@lo:400: 00010000:00080000:0.0:1787134594.950473:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff81180 x1873946311941248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787134594.951084:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa743a5c00 x1873946311941504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134594.951098:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311941504:0@lo:400: 00010000:00080000:2.0:1787134594.951111:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa743a7480 x1873946311941376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134594.951119:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311941376:0@lo:400: 00000100:00100000:2.0:1787134594.951672:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311941120 00000100:00100000:2.0:1787134594.951682:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311941120 00000100:00100000:2.0:1787134594.951742:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787134594.951750:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311941120:12345-0@lo:400: 00000100:00100000:2.0:1787134594.951826:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311941120:12345-0@lo:400: Request processed in 78us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134594.951834:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787134594.951910:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311941248:0@lo:400: 00010000:00080000:0.0:1787134594.951938:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa743a6d80 x1873946311941760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134594.951951:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311941760:0@lo:400: 00000100:00100000:0.0:1787134594.951976:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311941120:0@lo:400: 00000100:00100000:1.0:1787134595.457686:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311941888:0@lo:13: 00000100:00100000:1.0:1787134595.457810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134595.457914:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311941888 00000100:00100000:1.0:1787134595.457976:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311941888 00000100:00100000:1.0:1787134595.458049:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787134595.458062:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946311941888:12345-0@lo:13: 00002000:00000024:1.0:1787134595.458114:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134595.458213:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946311941888:12345-0@lo:13: Request processed in 153us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134595.458221:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787134595.458269:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6aa8c000 x1873946311941888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134595.458291:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311941888:0@lo:13: 00010000:00010000:2.0:1787134595.522671:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787134595.598332:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787134596.546693:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134597.574389:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134598.528915:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134598.528958:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311942016:0@lo:13: 00000100:00100000:3.0:1787134598.529084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134598.530831:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311942016 00000100:00100000:2.0:1787134598.530857:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311942016 00000100:00100000:2.0:1787134598.531014:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787134598.531028:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311942016:12345-0@lo:13: 00002000:00000024:2.0:1787134598.531086:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134598.531229:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311942016:12345-0@lo:13: Request processed in 193us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134598.531238:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787134598.531484:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff84700 x1873946311942016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134598.531508:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311942016:0@lo:13: 00000100:00080000:1.0:1787134598.532783:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787134598.593259:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134599.618319:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134600.065591:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311942272:0@lo:400: 00000100:00100000:0.0:1787134600.065701:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134600.065801:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311942784:0@lo:400: 00000100:00100000:0.0:1787134600.065837:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134600.065882:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787134600.065889:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311942144:0@lo:400: 00000100:00100000:0.0:1787134600.065934:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134600.065960:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311942656:0@lo:400: 00000100:00100000:0.0:1787134600.065986:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134600.066026:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311942400:0@lo:400: 00000100:00100000:0.0:1787134600.066054:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134600.066075:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134600.066080:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311942528:0@lo:400: 00000100:00100000:0.0:1787134600.066107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134600.066194:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311942272 00000100:00100000:0.0:1787134600.066208:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311942272 00000100:00100000:0.0:1787134600.066277:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311942656 00000100:00100000:0.0:1787134600.066281:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311942656 00000100:00100000:0.0:1787134600.066313:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311942400 00000100:00100000:0.0:1787134600.066317:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311942400 00000100:00100000:0.0:1787134600.066336:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787134600.066347:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311942272:12345-0@lo:400: 00000100:00100000:0.0:1787134600.066415:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311942272:12345-0@lo:400: Request processed in 69us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134600.066423:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787134600.066445:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787134600.066452:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311942656:12345-0@lo:400: 00000100:00100000:0.0:1787134600.066494:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311942656:12345-0@lo:400: Request processed in 43us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134600.066500:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787134600.066511:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787134600.066517:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311942400:12345-0@lo:400: 00000100:00100000:0.0:1787134600.066546:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311942400:12345-0@lo:400: Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134600.066552:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787134600.066573:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311942784 00000100:00100000:0.0:1787134600.066577:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311942784 00000100:00100000:0.0:1787134600.066606:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311942528 00000100:00100000:0.0:1787134600.066609:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311942528 00000100:00100000:0.0:1787134600.066631:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787134600.066638:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311942784:12345-0@lo:400: 00000100:00100000:0.0:1787134600.066670:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311942784:12345-0@lo:400: Request processed in 33us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134600.066684:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787134600.066696:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787134600.066702:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311942528:12345-0@lo:400: 00000100:00100000:0.0:1787134600.066732:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311942528:12345-0@lo:400: Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134600.066737:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787134600.066757:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311942144 00000100:00100000:0.0:1787134600.066761:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311942144 00000100:00100000:0.0:1787134600.066795:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787134600.066801:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311942144:12345-0@lo:400: 00000100:00100000:0.0:1787134600.066835:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311942144:12345-0@lo:400: Request processed in 35us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134600.066842:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1787134600.066886:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134600.066891:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134600.066894:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787134600.066936:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff86300 x1873946311942528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134600.066953:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311942528:0@lo:400: 00010000:00080000:0.0:1787134600.066965:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff85f80 x1873946311942400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134600.066973:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311942400:0@lo:400: 00000100:00100000:0.0:1787134600.067012:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311942144:0@lo:400: 00010000:00080000:0.0:1787134600.067024:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff84a80 x1873946311942656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134600.067045:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311942656:0@lo:400: 00010000:00080000:0.0:1787134600.067060:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff84700 x1873946311942272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134600.067068:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311942272:0@lo:400: 00010000:00080000:0.0:1787134600.067079:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff84e00 x1873946311942784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134600.067087:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787134600.067099:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311942784:0@lo:400: 00000100:00100000:2.0:1787134600.577688:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311942912:0@lo:13: 00000100:00100000:2.0:1787134600.577807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134600.577939:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311942912 00000100:00100000:2.0:1787134600.577950:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311942912 00000100:00100000:2.0:1787134600.578023:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787134600.578036:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311942912:12345-0@lo:13: 00002000:00000024:2.0:1787134600.578097:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134600.578185:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311942912:12345-0@lo:13: Request processed in 122us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134600.578194:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787134600.578267:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f77a300 x1873946311942912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134600.578297:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311942912:0@lo:13: 00010000:00010000:1.0:1787134600.649257:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134601.666254:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134602.298209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134602.301547:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287800704 00000100:00100000:1.0:1787134602.301571:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287800704 00000100:00100000:1.0:1787134602.301738:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 113 00000100:00100000:1.0:1787134602.301749:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2348:x1873946287800704:12345-192.168.202.36@tcp:250: 00010000:00080000:1.0:1787134602.301788:0:5830:0:(ldlm_lib.c:1449:target_handle_connect()) MGS: connection from 85dd26fe-3b2f-4906-a4d5-14f2ec42de7d@192.168.202.36@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1787134602.301830:0:5830:0:(genops.c:1406:class_connect()) connect: client 85dd26fe-3b2f-4906-a4d5-14f2ec42de7d, cookie 0x69932dacae905d84 00000100:00080000:1.0:1787134602.302026:0:5830:0:(import.c:65:import_set_state_nolock()) ffff98aa55100800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787134602.302130:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+5:2348:x1873946287800704:12345-192.168.202.36@tcp:250: Request processed in 380us (3982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134602.302139:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 113 00000100:00100000:0.0:1787134602.312042:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134602.312211:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287800576 00000100:00100000:1.0:1787134602.312227:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287800576 00000100:00100000:1.0:1787134602.312319:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00100000:1.0:1787134602.312332:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+5:5579:x1873946287800576:12345-192.168.202.36@tcp:101: 00010000:00010000:1.0:1787134602.312377:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134602.312401:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac907018a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134602.312438:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907018a expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134602.312453:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907018a expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134602.312465:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea000, rc 0) 00000100:00100000:1.0:1787134602.312552:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+6:5579:x1873946287800576:12345-192.168.202.36@tcp:101: Request processed in 222us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134602.312561:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00100000:2.0:1787134602.319888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134602.320033:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287800832 00000100:00100000:1.0:1787134602.320051:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287800832 00000100:00100000:1.0:1787134602.320143:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:1.0:1787134602.320206:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+6:5579:x1873946287800832:12345-192.168.202.36@tcp:501: 00000100:00100000:1.0:1787134602.320732:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+6:5579:x1873946287800832:12345-192.168.202.36@tcp:501: Request processed in 577us (863us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787134602.320743:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:3.0:1787134602.326597:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134602.328631:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287800960 00000100:00100000:0.0:1787134602.328653:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287800960 00000100:00100000:0.0:1787134602.328750:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:0.0:1787134602.328762:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+6:5579:x1873946287800960:12345-192.168.202.36@tcp:101: 00010000:00010000:0.0:1787134602.328786:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134602.328815:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070191 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134602.328856:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070191 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134602.328870:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070191 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134602.328881:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa40031c00, rc 0) 00000100:00100000:0.0:1787134602.329058:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+7:5579:x1873946287800960:12345-192.168.202.36@tcp:101: Request processed in 298us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134602.329086:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:3.0:1787134602.337005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134602.337254:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287801088 00000100:00100000:0.0:1787134602.337611:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287801088 00000100:00100000:0.0:1787134602.337691:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:0.0:1787134602.337703:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+7:5579:x1873946287801088:12345-192.168.202.36@tcp:501: 00000100:00100000:0.0:1787134602.338113:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:5579:x1873946287801088:12345-192.168.202.36@tcp:501: Request processed in 411us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134602.339543:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:2.0:1787134602.341057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134602.341189:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287801216 00000100:00100000:1.0:1787134602.341202:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287801216 00000100:00100000:1.0:1787134602.341482:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:1.0:1787134602.341494:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:5579:x1873946287801216:12345-192.168.202.36@tcp:503: 00000100:00100000:1.0:1787134602.341968:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:5579:x1873946287801216:12345-192.168.202.36@tcp:503: Request processed in 475us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134602.341990:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:2.0:1787134602.369330:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134602.369796:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287801344 00000100:00100000:0.0:1787134602.369811:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287801344 00000100:00100000:0.0:1787134602.369884:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:0.0:1787134602.369896:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:5599:x1873946287801344:12345-192.168.202.36@tcp:502: 00000100:00100000:0.0:1787134602.370565:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:5599:x1873946287801344:12345-192.168.202.36@tcp:502: Request processed in 668us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134602.370574:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:0.0:1787134602.439863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134602.440592:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287801472 00000100:00100000:1.0:1787134602.440610:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287801472 00000100:00100000:1.0:1787134602.440874:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:1.0:1787134602.440890:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:5599:x1873946287801472:12345-192.168.202.36@tcp:502: 00000100:00100000:1.0:1787134602.441654:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:5599:x1873946287801472:12345-192.168.202.36@tcp:502: Request processed in 761us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134602.441667:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:2.0:1787134602.458047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134602.458242:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287801600 00000100:00100000:0.0:1787134602.458264:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287801600 00000100:00100000:0.0:1787134602.458338:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:0.0:1787134602.458350:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:5579:x1873946287801600:12345-192.168.202.36@tcp:101: 00010000:00010000:0.0:1787134602.458374:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134602.458400:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa41671400/0x69932dacae905d99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac90701bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134602.458439:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa41671400/0x69932dacae905d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701bb expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134602.458476:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa41671400/0x69932dacae905d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701bb expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134602.458488:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa41671400, rc 0) 00000100:00100000:0.0:1787134602.458570:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5579:x1873946287801600:12345-192.168.202.36@tcp:101: Request processed in 223us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134602.458579:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:0.0:1787134602.463037:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134602.463372:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287801728 00000100:00100000:1.0:1787134602.463386:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287801728 00000100:00100000:1.0:1787134602.463472:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:1.0:1787134602.463485:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5579:x1873946287801728:12345-192.168.202.36@tcp:256: 20000000:01000000:1.0:1787134602.463520:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787134602.463553:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787134602.463557:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787134602.463561:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787134602.463563:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787134602.470878:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5579:x1873946287801728:12345-192.168.202.36@tcp:256: Request processed in 7376us (7841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134602.473340:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:3.0:1787134602.474775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134602.478993:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287801856 00000100:00100000:0.0:1787134602.479018:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287801856 00000100:00100000:0.0:1787134602.479365:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:0.0:1787134602.479381:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5579:x1873946287801856:12345-192.168.202.36@tcp:101: 00010000:00010000:0.0:1787134602.479440:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134602.479471:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac90701c2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134602.479511:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701c2 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134602.479526:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701c2 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134602.479537:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa41671800, rc 0) 00000100:00100000:0.0:1787134602.479702:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5579:x1873946287801856:12345-192.168.202.36@tcp:101: Request processed in 324us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134602.479711:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:0.0:1787134602.486895:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134602.487087:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287801984 00000100:00100000:2.0:1787134602.487102:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287801984 00000100:00100000:2.0:1787134602.487228:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 124 00000100:00100000:2.0:1787134602.487250:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5579:x1873946287801984:12345-192.168.202.36@tcp:501: 00000100:00100000:2.0:1787134602.488043:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5579:x1873946287801984:12345-192.168.202.36@tcp:501: Request processed in 789us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134602.488054:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 124 00000100:00100000:1.0:1787134602.499986:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134602.504382:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287802112 00000100:00100000:2.0:1787134602.504431:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287802112 00000100:00100000:2.0:1787134602.504613:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:2.0:1787134602.504626:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5579:x1873946287802112:12345-192.168.202.36@tcp:503: 00000100:00100000:2.0:1787134602.505273:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5579:x1873946287802112:12345-192.168.202.36@tcp:503: Request processed in 646us (5301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134602.505285:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:0.0:1787134602.511717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134602.511929:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287802240 00000100:00100000:3.0:1787134602.511946:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287802240 00000100:00100000:3.0:1787134602.512027:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 126 00000100:00100000:3.0:1787134602.512039:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5603:x1873946287802240:12345-192.168.202.36@tcp:502: 00000100:00100000:3.0:1787134602.512483:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5603:x1873946287802240:12345-192.168.202.36@tcp:502: Request processed in 444us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134602.512495:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 126 00000100:00100000:0.0:1787134602.519946:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134602.520132:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287802368 00000100:00100000:3.0:1787134602.520149:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287802368 00000100:00100000:2.0:1787134602.520681:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 127 00000100:00100000:2.0:1787134602.520695:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5603:x1873946287802368:12345-192.168.202.36@tcp:502: 00000100:00100000:2.0:1787134602.521094:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5603:x1873946287802368:12345-192.168.202.36@tcp:502: Request processed in 402us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134602.521104:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 127 00000100:00100000:0.0:1787134602.531552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134602.531745:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287802496 00000100:00100000:2.0:1787134602.531760:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287802496 00000100:00100000:2.0:1787134602.531820:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:2.0:1787134602.531832:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1873946287802496:12345-192.168.202.36@tcp:38: 00010000:00080000:2.0:1787134602.531872:0:5835:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from 486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1787134602.531938:0:5835:0:(genops.c:1406:class_connect()) connect: client 486fb1ad-4266-4864-b299-111c5140734b, cookie 0x69932dacae905da7 00000004:00100000:2.0:1787134602.531981:0:5835:0:(mdt_handler.c:7486:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:2.0:1787134602.531989:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787134602.655874:0:5835:0:(import.c:65:import_set_state_nolock()) ffff98aa55101000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787134602.656045:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2348:x1873946287802496:12345-192.168.202.36@tcp:38: Request processed in 124211us (124507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134602.656060:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00010000:00010000:1.0:1787134602.688684:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134603.170893:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134603.170951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134603.171074:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287802624 00000100:00100000:1.0:1787134603.171088:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287802624 00000100:00100000:1.0:1787134603.171221:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287802752 00000100:00100000:1.0:1787134603.171233:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287802752 00000100:00100000:1.0:1787134603.171294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:1.0:1787134603.171307:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+7:0:x1873946287802624:12345-192.168.202.36@tcp:41: 00000004:00000024:1.0:1787134603.171719:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787134603.171822:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+7:0:x1873946287802624:12345-192.168.202.36@tcp:41: Request processed in 517us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134603.171832:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:1.0:1787134603.171857:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:1.0:1787134603.171864:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:5579:x1873946287802752:12345-192.168.202.36@tcp:41: 00000004:00000024:1.0:1787134603.171875:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787134603.171894:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:5579:x1873946287802752:12345-192.168.202.36@tcp:41: Request processed in 30us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134603.171900:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00080000:0.0:1787134603.172479:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134603.178216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134603.178768:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287802880 00000100:00100000:3.0:1787134603.178784:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287802880 00000100:00100000:3.0:1787134603.178863:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787134603.178874:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:5579:x1873946287802880:12345-192.168.202.36@tcp:40: 00000100:00100000:3.0:1787134603.178997:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:5579:x1873946287802880:12345-192.168.202.36@tcp:40: Request processed in 125us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134603.179005:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787134603.188140:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134603.188235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134603.188436:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134603.188474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134603.189582:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287803264 00000100:00100000:2.0:1787134603.189607:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287803264 00000100:00100000:2.0:1787134603.189700:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 128 00000100:00100000:2.0:1787134603.189714:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2350:x1873946287803264:12345-192.168.202.36@tcp:400: 00000100:00100000:2.0:1787134603.189829:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2350:x1873946287803264:12345-192.168.202.36@tcp:400: Request processed in 118us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134603.189864:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 128 00000100:00100000:2.0:1787134603.189935:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287803392 00000100:00100000:2.0:1787134603.189941:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287803392 00000100:00100000:2.0:1787134603.189975:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:2.0:1787134603.189982:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+6:5579:x1873946287803392:12345-192.168.202.36@tcp:33: 00000100:00100000:1.0:1787134603.195466:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287803008 00000100:00100000:1.0:1787134603.195496:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287803008 00000100:00100000:1.0:1787134603.195553:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287803136 00000100:00100000:1.0:1787134603.195555:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287803136 00000100:00100000:1.0:1787134603.195894:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:1.0:1787134603.195905:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1873946287803008:12345-192.168.202.36@tcp:8: 00010000:00080000:1.0:1787134603.195946:0:6680:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from 486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:1.0:1787134603.195987:0:6680:0:(genops.c:1406:class_connect()) connect: client 486fb1ad-4266-4864-b299-111c5140734b, cookie 0x69932dacae905dae 00002000:00100000:1.0:1787134603.196003:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 486fb1ad-4266-4864-b299-111c5140734b/ffff98aa55107800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787134603.196033:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:3.0:1787134603.196199:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:3.0:1787134603.196215:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1873946287803136:12345-192.168.202.36@tcp:8: 00010000:00080000:3.0:1787134603.196266:0:6682:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from 486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:3.0:1787134603.196308:0:6682:0:(genops.c:1406:class_connect()) connect: client 486fb1ad-4266-4864-b299-111c5140734b, cookie 0x69932dacae905db5 00002000:00100000:3.0:1787134603.196417:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 486fb1ad-4266-4864-b299-111c5140734b/ffff98aa6f89a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787134603.196443:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787134603.196833:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787134603.197848:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98aa55106800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787134603.197986:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2348:x1873946287803008:12345-192.168.202.36@tcp:8: Request processed in 2077us (9857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134603.198021:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00002000:00080000:3.0:1787134603.205013:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787134603.205061:0:6682:0:(import.c:65:import_set_state_nolock()) ffff98aa6f89c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787134603.205151:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2348:x1873946287803136:12345-192.168.202.36@tcp:8: Request processed in 8935us (16923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134603.205794:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000004:00080000:0.0:1787134603.225656:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 35594us 00000004:00200000:0.0:1787134603.270741:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787134603.270978:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+6:5579:x1873946287803392:12345-192.168.202.36@tcp:33: Request processed in 80987us (82494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134603.270996:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787134603.545455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134603.545557:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287803520 00000100:00100000:3.0:1787134603.545571:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287803520 00000100:00100000:3.0:1787134603.545641:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:3.0:1787134603.545653:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:5620:x1873946287803520:12345-192.168.202.36@tcp:101: 00010000:00010000:3.0:1787134603.545690:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134603.545735:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a000/0x69932dacae905dbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90701ec expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134603.545805:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905dc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134603.545821:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134603.545839:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134603.546106:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787134603.546111:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787134603.546257:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134603.546289:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a000/0x69932dacae905dbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701ec expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134603.546311:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701ec expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134603.546322:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7c500) 00010000:00010000:3.0:1787134603.546325:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787134603.546329:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7be00, rc 0) 00000100:00100000:3.0:1787134603.546412:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+7:5620:x1873946287803520:12345-192.168.202.36@tcp:101: Request processed in 762us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134603.546420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:0.0:1787134603.648612:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134603.654035:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311943040:0@lo:13: 00000100:00100000:0.0:1787134603.654137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134603.659275:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311943040 00000100:00100000:2.0:1787134603.659292:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311943040 00000100:00100000:2.0:1787134603.662365:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787134603.662396:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311943040:12345-0@lo:13: 00002000:00000024:2.0:1787134603.662425:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787134603.662626:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134603.663229:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311943040:12345-0@lo:13: Request processed in 836us (9078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134603.663240:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787134603.666775:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff85880 x1873946311943040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134603.666803:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311943040:0@lo:13: 00010000:00010000:3.0:1787134603.712673:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134604.739233:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134605.184530:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311943552:0@lo:400: 00000100:00100000:2.0:1787134605.184651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134605.184740:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787134605.184747:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311943424:0@lo:400: 00000100:00100000:2.0:1787134605.184778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134605.184817:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311943424 00000100:00100000:2.0:1787134605.184827:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311943424 00000100:00100000:2.0:1787134605.184899:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787134605.184910:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311943424:12345-0@lo:400: 00000100:00100000:2.0:1787134605.184973:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311943424:12345-0@lo:400: Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134605.184981:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787134605.185006:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134605.185065:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311943424:0@lo:400: 00000100:00100000:1.0:1787134605.185191:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311943168:0@lo:400: 00000100:00100000:1.0:1787134605.185246:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134605.185284:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311943680:0@lo:400: 00000100:00100000:1.0:1787134605.185308:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134605.185328:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787134605.185334:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311943296:0@lo:400: 00000100:00100000:1.0:1787134605.185357:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134605.185376:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311943808:0@lo:400: 00000100:00100000:1.0:1787134605.185401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134605.185431:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311943552 00000100:00100000:1.0:1787134605.185435:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311943552 00000100:00100000:1.0:1787134605.185473:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311943808 00000100:00100000:1.0:1787134605.185477:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311943808 00000100:00100000:1.0:1787134605.185499:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787134605.185506:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311943552:12345-0@lo:400: 00000100:00100000:1.0:1787134605.185546:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311943552:12345-0@lo:400: Request processed in 41us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134605.185552:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787134605.185564:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787134605.185579:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311943808:12345-0@lo:400: 00000100:00100000:1.0:1787134605.185614:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311943808:12345-0@lo:400: Request processed in 35us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134605.185621:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787134605.185642:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311943680 00000100:00100000:1.0:1787134605.185646:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311943680 00000100:00100000:1.0:1787134605.185664:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311943296 00000100:00100000:1.0:1787134605.185667:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311943296 00000100:00100000:1.0:1787134605.185678:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787134605.185684:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311943680:12345-0@lo:400: 00000100:00100000:1.0:1787134605.185715:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311943680:12345-0@lo:400: Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134605.185721:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787134605.185731:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787134605.185737:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311943296:12345-0@lo:400: 00000100:00100000:1.0:1787134605.185763:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311943296:12345-0@lo:400: Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134605.185768:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787134605.185781:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787134605.185786:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787134605.185788:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787134605.185811:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311943296:0@lo:400: 00010000:00080000:1.0:1787134605.185824:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff84e00 x1873946311943808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134605.185836:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311943808:0@lo:400: 00000100:00100000:1.0:1787134605.185846:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311943680:0@lo:400: 00000100:00100000:2.0:1787134605.186534:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311943168 00000100:00100000:2.0:1787134605.186543:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311943168 00000100:00100000:2.0:1787134605.186597:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787134605.186605:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311943168:12345-0@lo:400: 00000100:00100000:2.0:1787134605.186670:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311943168:12345-0@lo:400: Request processed in 65us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134605.186678:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1787134605.186736:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6ff86a00 x1873946311943552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134605.186748:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311943552:0@lo:400: 00000100:00100000:1.0:1787134605.186849:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311943168:0@lo:400: 00000100:00100000:1.0:1787134605.696859:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134605.696906:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311943936:0@lo:13: 00000100:00100000:1.0:1787134605.697008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134605.698653:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311943936 00000100:00100000:3.0:1787134605.698671:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311943936 00000100:00100000:3.0:1787134605.698751:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787134605.698764:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311943936:12345-0@lo:13: 00002000:00000024:3.0:1787134605.698817:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134605.698952:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311943936:12345-0@lo:13: Request processed in 190us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134605.698961:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787134605.699145:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f77aa00 x1873946311943936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134605.699230:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311943936:0@lo:13: 00010000:00010000:3.0:1787134605.760563:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134606.118833:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134606.119131:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287803648 00000100:00100000:2.0:1787134606.119205:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287803648 00000100:00100000:2.0:1787134606.119313:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:2.0:1787134606.119327:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+7:5672:x1873946287803648:12345-192.168.202.36@tcp:41: 00000100:00080000:1.0:1787134606.119410:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1787134606.119908:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787134606.120012:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+7:5672:x1873946287803648:12345-192.168.202.36@tcp:41: Request processed in 688us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134606.120022:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:0.0:1787134606.131388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134606.131688:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287803776 00000100:00100000:3.0:1787134606.131702:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287803776 00000100:00100000:3.0:1787134606.131803:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787134606.131817:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:486fb1ad-4266-4864-b299-111c5140734b+6:5672:x1873946287803776:12345-192.168.202.36@tcp:13: 00002000:00000024:3.0:1787134606.131873:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134606.131972:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:486fb1ad-4266-4864-b299-111c5140734b+6:5672:x1873946287803776:12345-192.168.202.36@tcp:13: Request processed in 158us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134606.131981:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00080000:1.0:1787134606.132771:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787134606.134603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134606.134812:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287803904 00000100:00100000:3.0:1787134606.134825:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287803904 00000100:00100000:3.0:1787134606.134912:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:3.0:1787134606.134925:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:486fb1ad-4266-4864-b299-111c5140734b+6:5672:x1873946287803904:12345-192.168.202.36@tcp:13: 00002000:00000024:3.0:1787134606.134959:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134606.135214:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:486fb1ad-4266-4864-b299-111c5140734b+6:5672:x1873946287803904:12345-192.168.202.36@tcp:13: Request processed in 289us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134606.135223:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00080000:1.0:1787134606.135613:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787134606.788386:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787134606.795472:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000001:00100000:0.0:1787134607.356056:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00010000:00010000:2.0:1787134607.811443:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787134607.817681:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000100:00100000:1.0:1787134608.638063:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134608.638109:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134608.638187:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134608.638217:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134608.638257:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287804416 00000100:00100000:1.0:1787134608.638273:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287804416 00000100:00100000:1.0:1787134608.638616:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287804288 00000100:00100000:1.0:1787134608.638621:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287804288 00000100:00100000:1.0:1787134608.638659:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787134608.638762:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287804416:12345-192.168.202.36@tcp:400: 00000100:00100000:1.0:1787134608.638874:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287804416:12345-192.168.202.36@tcp:400: Request processed in 117us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134608.638883:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787134608.638907:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787134608.638914:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287804288:12345-192.168.202.36@tcp:400: 00000100:00100000:1.0:1787134608.638944:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287804288:12345-192.168.202.36@tcp:400: Request processed in 31us (726us total) trans 0 rc 0/0 00000100:00080000:0.0:1787134608.641800:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134608.641815:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134608.642931:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787134608.644235:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287804160 00000100:00100000:3.0:1787134608.644251:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287804160 00000100:00100000:3.0:1787134608.644361:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:3.0:1787134608.644376:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287804160:12345-192.168.202.36@tcp:400: 00000100:00100000:3.0:1787134608.644506:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287804160:12345-192.168.202.36@tcp:400: Request processed in 134us (6466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134608.644517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:3.0:1787134608.644552:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287804032 00000100:00100000:3.0:1787134608.644557:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287804032 00000100:00100000:3.0:1787134608.644594:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00100000:3.0:1787134608.644600:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2351:x1873946287804032:12345-192.168.202.36@tcp:400: 00000100:00100000:3.0:1787134608.644629:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2351:x1873946287804032:12345-192.168.202.36@tcp:400: Request processed in 29us (6442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134608.644636:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00080000:3.0:1787134608.644952:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134608.771384:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134608.771428:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311944064:0@lo:13: 00000100:00100000:0.0:1787134608.771538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134608.771629:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311944064 00000100:00100000:0.0:1787134608.771658:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311944064 00000100:00100000:0.0:1787134608.771763:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787134608.771775:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311944064:12345-0@lo:13: 00002000:00000024:0.0:1787134608.771843:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134608.771905:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311944064:12345-0@lo:13: Request processed in 131us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134608.771915:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787134608.771995:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa743a7480 x1873946311944064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134608.772018:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311944064:0@lo:13: 00000100:00080000:3.0:1787134608.777608:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787134608.833935:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787134609.143598:0:8287:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787134609.856466:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134610.304511:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311944320:0@lo:400: 00000100:00100000:3.0:1787134610.304625:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134610.304694:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311944832:0@lo:400: 00000100:00100000:3.0:1787134610.304724:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134610.304753:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787134610.304757:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311944192:0@lo:400: 00000100:00100000:3.0:1787134610.304787:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134610.304800:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311944704:0@lo:400: 00000100:00100000:3.0:1787134610.304815:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134610.304844:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311944448:0@lo:400: 00000100:00100000:3.0:1787134610.304863:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134610.304875:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134610.304878:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311944576:0@lo:400: 00000100:00100000:3.0:1787134610.304893:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134610.304921:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311944320 00000100:00100000:3.0:1787134610.304932:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311944320 00000100:00100000:3.0:1787134610.304977:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311944704 00000100:00100000:3.0:1787134610.304979:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311944704 00000100:00100000:3.0:1787134610.304997:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311944448 00000100:00100000:3.0:1787134610.304998:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311944448 00000100:00100000:3.0:1787134610.305010:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787134610.305018:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311944320:12345-0@lo:400: 00000100:00100000:3.0:1787134610.305069:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311944320:12345-0@lo:400: Request processed in 51us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134610.305075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787134610.305093:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787134610.305096:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311944704:12345-0@lo:400: 00000100:00100000:3.0:1787134610.305112:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311944704:12345-0@lo:400: Request processed in 16us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134610.305115:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787134610.305121:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787134610.305125:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311944448:12345-0@lo:400: 00000100:00100000:3.0:1787134610.305144:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311944448:12345-0@lo:400: Request processed in 17us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134610.305150:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787134610.305220:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311944832 00000100:00100000:3.0:1787134610.305224:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311944832 00000100:00100000:3.0:1787134610.305256:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311944576 00000100:00100000:3.0:1787134610.305258:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311944576 00000100:00100000:3.0:1787134610.305273:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787134610.305277:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311944832:12345-0@lo:400: 00000100:00100000:3.0:1787134610.305301:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311944832:12345-0@lo:400: Request processed in 24us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134610.305305:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787134610.305311:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787134610.305315:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311944576:12345-0@lo:400: 00000100:00100000:3.0:1787134610.305328:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311944576:12345-0@lo:400: Request processed in 13us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134610.305332:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787134610.305343:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311944192 00000100:00100000:3.0:1787134610.305346:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311944192 00000100:00100000:3.0:1787134610.305363:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787134610.305367:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311944192:12345-0@lo:400: 00000100:00100000:3.0:1787134610.305385:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311944192:12345-0@lo:400: Request processed in 18us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134610.305389:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787134610.305422:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787134610.305426:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787134610.305428:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787134610.305476:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6fc18700 x1873946311944576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134610.305492:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311944576:0@lo:400: 00000100:00100000:3.0:1787134610.305506:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311944448:0@lo:400: 00000100:00100000:3.0:1787134610.305538:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311944192:0@lo:400: 00000100:00100000:3.0:1787134610.305553:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311944704:0@lo:400: 00000100:00100000:3.0:1787134610.305560:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311944320:0@lo:400: 00010000:00080000:3.0:1787134610.305568:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6fc1a680 x1873946311944832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134610.305574:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311944832:0@lo:400: 00000100:00100000:3.0:1787134610.816617:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311944960:0@lo:13: 00000100:00100000:3.0:1787134610.816690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134610.816877:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311944960 00000100:00100000:0.0:1787134610.816884:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311944960 00000100:00100000:0.0:1787134610.816931:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787134610.816938:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311944960:12345-0@lo:13: 00002000:00000024:0.0:1787134610.816974:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134610.817020:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311944960:12345-0@lo:13: Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134610.817025:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787134610.817111:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f778700 x1873946311944960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134610.817131:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311944960:0@lo:13: 00010000:00010000:1.0:1787134610.886051:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134611.912343:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134612.934052:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787134613.019787:0:8437:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5c01fcd0 20000000:00000080:2.0:1787134613.019807:0:8437:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98aa819de000 uarg=0000000000000000 20000000:01000000:2.0:1787134613.019861:0:8437:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787134613.019869:0:8437:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787134613.019872:0:8437:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787134613.019878:0:8437:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787134613.019884:0:8437:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787134613.019901:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787134613.019903:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787134613.020098:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787134613.020101:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787134613.029622:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787134613.030670:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787134613.030936:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787134613.030980:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787134613.030998:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787134613.031001:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787134613.032055:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787134613.032695:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787134613.032977:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787134613.033015:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787134613.033026:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787134613.033029:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787134613.039356:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787134613.040782:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787134613.041143:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787134613.041519:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787134613.041539:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787134613.041543:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787134613.043063:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787134613.043673:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787134613.043763:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787134613.043802:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1787134613.043821:0:8437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787134613.043853:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043879:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905cc0 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043888:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905cea expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043895:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d14 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043914:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d22 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043921:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d30 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043928:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d4c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043935:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905d76 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043947:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907018a expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043954:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070191 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.043961:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044016:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070191 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044039:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070191 expref: 9 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.044058:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945088:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134613.044241:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907018a expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044258:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907018a expref: 9 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.044267:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945216:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134613.044301:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905d76 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044309:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905d76 expref: 18 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.044318:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945344:0@lo:104: 00000100:00100000:3.0:1787134613.044358:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787134613.044397:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905d4c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044405:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905d4c expref: 18 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.044412:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945472:0@lo:104: 00000100:00100000:3.0:1787134613.044435:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787134613.044453:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905d30 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044460:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905d30 expref: 18 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.044468:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945600:0@lo:104: 00010000:00010000:3.0:1787134613.044490:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905d22 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044507:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905d22 expref: 18 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.044515:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945728:0@lo:104: 00010000:00010000:3.0:1787134613.044542:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905d14 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044549:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905d14 expref: 18 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.044557:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945856:0@lo:104: 00010000:00010000:3.0:1787134613.044581:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905cea expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044588:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905cea expref: 18 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.044595:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945984:0@lo:104: 00010000:00010000:3.0:1787134613.044618:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905cc0 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134613.044625:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905cc0 expref: 18 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.044632:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311946112:0@lo:104: 00000100:00100000:3.0:1787134613.044649:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787134613.044939:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787134613.044961:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.044978:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.044987:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.045011:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.045024:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.045040:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311945344 00000100:00100000:0.0:1787134613.045049:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311945344 00000100:00100000:0.0:1787134613.045093:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311945472 00000100:00100000:0.0:1787134613.045096:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311945472 00000100:00100000:0.0:1787134613.045107:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311945600 00000100:00100000:0.0:1787134613.045109:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311945600 00000100:00100000:0.0:1787134613.045116:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311945728 00000100:00100000:0.0:1787134613.045118:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311945728 00000100:00100000:0.0:1787134613.045126:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311945856 00000100:00100000:0.0:1787134613.045128:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311945856 00000100:00100000:0.0:1787134613.045150:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311945984 00000100:00100000:0.0:1787134613.045153:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311945984 00000100:00100000:0.0:1787134613.045182:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311946112 00000100:00100000:0.0:1787134613.045185:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311946112 00000100:00100000:0.0:1787134613.045200:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787134613.045208:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:8437:x1873946311945344:12345-0@lo:104: 00010000:00010000:0.0:1787134613.045223:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045286:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787134613.045292:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+9:8437:x1873946311945344:12345-0@lo:104: Request processed in 85us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.045300:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787134613.045322:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787134613.045328:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+8:8437:x1873946311945472:12345-0@lo:104: 00010000:00010000:0.0:1787134613.045335:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045371:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787134613.045376:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+8:8437:x1873946311945472:12345-0@lo:104: Request processed in 49us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.045394:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787134613.045444:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787134613.045450:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+7:8437:x1873946311945600:12345-0@lo:104: 00010000:00010000:0.0:1787134613.045457:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045484:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787134613.045489:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+7:8437:x1873946311945600:12345-0@lo:104: Request processed in 40us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.045494:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787134613.045506:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787134613.045511:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+6:8437:x1873946311945728:12345-0@lo:104: 00010000:00010000:0.0:1787134613.045519:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045544:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787134613.045555:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+6:8437:x1873946311945728:12345-0@lo:104: Request processed in 39us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.045560:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787134613.045571:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787134613.045576:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:8437:x1873946311945856:12345-0@lo:104: 00010000:00010000:0.0:1787134613.045583:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045609:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787134613.045614:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:8437:x1873946311945856:12345-0@lo:104: Request processed in 38us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.045625:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787134613.045637:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787134613.045643:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:8437:x1873946311945984:12345-0@lo:104: 00010000:00010000:0.0:1787134613.045652:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045680:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787134613.045685:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:8437:x1873946311945984:12345-0@lo:104: Request processed in 42us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.045691:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787134613.045702:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787134613.045714:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:8437:x1873946311946112:12345-0@lo:104: 00010000:00010000:0.0:1787134613.045723:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045751:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787134613.045756:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:8437:x1873946311946112:12345-0@lo:104: Request processed in 49us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.045762:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787134613.045788:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787134613.045797:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045804:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134613.045809:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045832:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134613.045839:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134613.045845:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134613.045883:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045890:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134613.045909:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045916:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa59dea800/0x69932dacae905d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d7d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045929:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787134613.045933:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045938:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa40030a00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134613.045940:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045947:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134613.045952:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134613.045964:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134613.045979:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.045984:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134613.045998:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046005:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa40030a00/0x69932dacae905d4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d53 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046014:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787134613.046018:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046023:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa40031200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134613.046026:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046033:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134613.046039:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134613.046044:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134613.046056:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046061:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134613.046073:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046079:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa40031200/0x69932dacae905d30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046089:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787134613.046092:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046097:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134613.046100:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046107:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134613.046112:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134613.046118:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134613.046150:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046180:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134613.046186:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046192:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b800/0x69932dacae905d22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046201:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787134613.046212:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046218:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fd200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134613.046220:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046227:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134613.046235:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134613.046240:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134613.046255:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046261:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134613.046266:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046272:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905d14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905d1b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046281:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787134613.046284:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046290:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a400 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134613.046292:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046308:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134613.046314:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134613.046319:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134613.046332:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046338:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134613.046342:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046348:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a400/0x69932dacae905cea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905cf1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046357:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134613.046361:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046366:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fc600 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134613.046369:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046376:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134613.046381:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134613.046393:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134613.046407:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046413:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134613.046417:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046423:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905cc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905cc7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.046436:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134613.046438:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134613.046439:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134613.046449:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134613.046477:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311946240:0@lo:103: 00000100:00100000:0.0:1787134613.046523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.046549:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311946752:0@lo:103: 00000100:00100000:0.0:1787134613.046569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.046590:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787134613.046596:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311946624:0@lo:103: 00000100:00100000:0.0:1787134613.046617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.046645:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311946368:0@lo:103: 00000100:00100000:0.0:1787134613.046668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.046684:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311946880:0@lo:103: 00000100:00100000:0.0:1787134613.046703:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.046723:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787134613.046729:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311946496:0@lo:103: 00000100:00100000:0.0:1787134613.046750:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.046760:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311947008:0@lo:103: 00000100:00100000:0.0:1787134613.046780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.046806:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311946240 00000100:00100000:0.0:1787134613.046812:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311946240 00010000:00010000:0.0:1787134613.046837:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d76 expref: 19 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134613.046857:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311946752 00000100:00100000:0.0:1787134613.046860:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311946752 00010000:00010000:0.0:1787134613.046870:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d14 expref: 20 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134613.046880:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311946624 00000100:00100000:0.0:1787134613.046883:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311946624 00010000:00010000:0.0:1787134613.046893:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d22 expref: 21 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134613.046901:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311946368 00000100:00100000:0.0:1787134613.046903:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311946368 00010000:00010000:0.0:1787134613.046913:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d4c expref: 22 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134613.046922:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311946880 00000100:00100000:0.0:1787134613.046925:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311946880 00010000:00010000:0.0:1787134613.046934:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905cea expref: 23 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134613.046943:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311946496 00000100:00100000:0.0:1787134613.046946:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311946496 00010000:00010000:0.0:1787134613.046965:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d30 expref: 24 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134613.046976:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311947008 00000100:00100000:0.0:1787134613.046978:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311947008 00010000:00010000:0.0:1787134613.046988:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905cc0 expref: 25 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134613.047000:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787134613.047006:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+25:3308:x1873946311946240:12345-0@lo:103: 00010000:00010000:0.0:1787134613.047018:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134613.047023:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d76 expref: 25 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047033:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905d76 expref: 25 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047053:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134613.047085:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+25:3308:x1873946311946240:12345-0@lo:103: Request processed in 79us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.047092:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787134613.047107:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787134613.047113:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+24:3308:x1873946311946752:12345-0@lo:103: 00010000:00010000:0.0:1787134613.047121:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134613.047125:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d14 expref: 24 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047145:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905d14 expref: 24 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047195:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134613.047221:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+24:3308:x1873946311946752:12345-0@lo:103: Request processed in 108us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.047228:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787134613.047240:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787134613.047246:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+23:3308:x1873946311946624:12345-0@lo:103: 00010000:00010000:0.0:1787134613.047253:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134613.047258:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d22 expref: 23 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047266:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905d22 expref: 23 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047275:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134613.047296:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+23:3308:x1873946311946624:12345-0@lo:103: Request processed in 51us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.047301:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787134613.047313:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787134613.047318:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+22:3309:x1873946311946368:12345-0@lo:103: 00010000:00010000:0.0:1787134613.047324:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134613.047329:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d4c expref: 22 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047337:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905d4c expref: 22 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047347:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134613.047379:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+22:3309:x1873946311946368:12345-0@lo:103: Request processed in 61us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.047386:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787134613.047398:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787134613.047404:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+21:3309:x1873946311946880:12345-0@lo:103: 00010000:00010000:0.0:1787134613.047411:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134613.047416:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905cea expref: 21 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047424:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905cea expref: 21 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047433:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134613.047454:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+21:3309:x1873946311946880:12345-0@lo:103: Request processed in 50us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.047459:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787134613.047470:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787134613.047476:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+20:3309:x1873946311946496:12345-0@lo:103: 00010000:00010000:0.0:1787134613.047483:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134613.047488:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905d30 expref: 20 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047496:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905d30 expref: 20 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047504:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134613.047524:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+20:3309:x1873946311946496:12345-0@lo:103: Request processed in 48us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.047529:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787134613.047550:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787134613.047555:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa47fae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311947008:12345-0@lo:103: 00010000:00010000:0.0:1787134613.047562:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134613.047568:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905cc0 expref: 19 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047575:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905cc0 expref: 19 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.047585:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134613.047607:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa47fae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311947008:12345-0@lo:103: Request processed in 51us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.047612:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787134613.047697:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311946496:0@lo:103: 00000100:00100000:0.0:1787134613.047707:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311947008:0@lo:103: 00000100:00100000:0.0:1787134613.047714:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311946368:0@lo:103: 00000100:00100000:0.0:1787134613.047721:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311946880:0@lo:103: 00000100:00100000:0.0:1787134613.047755:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311946624:0@lo:103: 00000100:00100000:0.0:1787134613.047764:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311946240:0@lo:103: 00000100:00100000:0.0:1787134613.047770:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311946752:0@lo:103: 00010000:00010000:3.0:1787134613.048643:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7b000/0x69932dacae905d7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905d76 expref: 18 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.048679:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945344:0@lo:104: 00010000:00010000:3.0:1787134613.048695:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa40031800/0x69932dacae905d53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905d4c expref: 17 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.048704:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945472:0@lo:104: 00010000:00010000:3.0:1787134613.048714:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905d30 expref: 16 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.048722:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945600:0@lo:104: 00010000:00010000:3.0:1787134613.048732:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905d29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905d22 expref: 15 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.048740:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945728:0@lo:104: 00010000:00010000:3.0:1787134613.048750:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905d1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905d14 expref: 14 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.048758:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945856:0@lo:104: 00010000:00010000:3.0:1787134613.048766:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa40030600/0x69932dacae905cf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905cea expref: 13 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.048774:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945984:0@lo:104: 00010000:00010000:3.0:1787134613.048783:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa40030400/0x69932dacae905cc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905cc0 expref: 12 pid: 5828 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134613.048790:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311946112:0@lo:104: 00000100:00100000:0.0:1787134613.053559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134613.053609:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134613.053717:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945088:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134613.053747:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1873946311945216:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134613.053805:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134613.056150:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287804544 00000100:00100000:2.0:1787134613.056352:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287804544 00000100:00100000:1.0:1787134613.056816:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287804672 00000100:00100000:1.0:1787134613.056822:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287804672 00010000:00010000:1.0:1787134613.057011:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907018a expref: 11 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134613.057108:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:1.0:1787134613.057119:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:2351:x1873946287804672:12345-192.168.202.36@tcp:103: 00010000:00010000:1.0:1787134613.057145:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134613.057176:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907018a expref: 11 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134613.057189:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907018a expref: 11 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134613.057209:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea000/0x69932dacae905d8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907018a expref: 11 pid: 5829 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134613.057224:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134613.057311:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2351:x1873946287804672:12345-192.168.202.36@tcp:103: Request processed in 193us (3701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134613.057319:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00010000:00010000:3.0:1787134613.057844:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070191 expref: 9 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134613.058062:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:0.0:1787134613.058075:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:2352:x1873946287804544:12345-192.168.202.36@tcp:103: 00010000:00010000:0.0:1787134613.058100:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134613.058106:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070191 expref: 9 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058116:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070191 expref: 9 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058130:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa40031c00/0x69932dacae905d92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070191 expref: 9 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058179:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058188:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058204:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058211:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058218:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058225:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058232:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134613.058236:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058257:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058275:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134613.058287:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134613.058332:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:2352:x1873946287804544:12345-192.168.202.36@tcp:103: Request processed in 261us (4784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.058339:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00010000:00010000:2.0:1787134613.058540:0:8437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134613.058549:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134613.058556:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7a200/0x69932dacae905dca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134613.754624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134613.754750:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134613.754788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134613.754825:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287804800 00000100:00100000:2.0:1787134613.754838:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287804800 00000100:00100000:2.0:1787134613.754947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:2.0:1787134613.754960:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287804800:12345-192.168.202.36@tcp:400: 00000100:00100000:2.0:1787134613.755047:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287804800:12345-192.168.202.36@tcp:400: Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134613.755057:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00080000:1.0:1787134613.755592:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134613.763801:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287804928 00000100:00100000:3.0:1787134613.763816:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287804928 00000100:00100000:2.0:1787134613.763859:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287805056 00000100:00100000:2.0:1787134613.763867:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287805056 00000100:00080000:1.0:1787134613.763948:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787134613.763953:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787134613.763989:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:3.0:1787134613.764004:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287804928:12345-192.168.202.36@tcp:400: 00000100:00100000:3.0:1787134613.764144:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287804928:12345-192.168.202.36@tcp:400: Request processed in 143us (9532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134613.766268:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787134613.766300:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287805056:12345-192.168.202.36@tcp:400: 00000100:00100000:2.0:1787134613.766388:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287805056:12345-192.168.202.36@tcp:400: Request processed in 104us (11599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134613.768763:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:3.0:1787134613.776342:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:1.0:1787134613.888396:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311947136:0@lo:13: 00000100:00100000:1.0:1787134613.888488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134613.888642:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311947136 00000100:00100000:0.0:1787134613.888652:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311947136 00000100:00100000:0.0:1787134613.888728:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787134613.888739:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311947136:12345-0@lo:13: 00002000:00000024:0.0:1787134613.888774:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134613.888836:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311947136:12345-0@lo:13: Request processed in 99us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134613.888843:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787134613.889034:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d2680 x1873946311947136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134613.889054:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311947136:0@lo:13: 00000100:00080000:1.0:1787134613.889187:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787134613.952380:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787134614.592299:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787134614.592308:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa52a7d800 from 39 10000000:01000000:0.0:1787134614.592316:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787134614.592369:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.592417:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.592431:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134614.592459:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311947264:0@lo:101: 00000100:00100000:0.0:1787134614.592544:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.592604:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa52a06900 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.593306:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311947264 00000100:00100000:3.0:1787134614.593315:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311947264 00000100:00100000:3.0:1787134614.593373:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787134614.593382:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+12:5832:x1873946311947264:12345-0@lo:101: 00010000:00010000:3.0:1787134614.593395:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134614.593429:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905dd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905dd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.593454:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905dd1 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.593481:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905dd1 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.593800:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a600, rc 0) 00000100:00100000:3.0:1787134614.593862:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311947264:12345-0@lo:101: Request processed in 481us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.593868:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787134614.593960:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311947264:0@lo:101: 00010000:00010000:0.0:1787134614.593977:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.593987:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134614.594057:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311947392:0@lo:501: 00000100:00100000:0.0:1787134614.594100:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.594143:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa52a06900 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.594388:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311947392 00000100:00100000:3.0:1787134614.594393:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311947392 00000100:00100000:3.0:1787134614.594446:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787134614.594455:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311947392:12345-0@lo:501: 00000100:00100000:3.0:1787134614.594764:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311947392:12345-0@lo:501: Request processed in 310us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.594772:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787134614.595320:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311947392:0@lo:501: 00000100:00100000:1.0:1787134614.595370:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f779180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311947520:0@lo:503: 00000100:00100000:1.0:1787134614.595426:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134614.595467:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787134614.596199:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311947520 00000100:00100000:0.0:1787134614.596207:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311947520 00000100:00100000:0.0:1787134614.596260:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787134614.596270:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311947520:12345-0@lo:503: 00000100:00100000:0.0:1787134614.596485:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311947520:12345-0@lo:503: Request processed in 216us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134614.596609:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f779180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311947520:0@lo:503: 00000100:00100000:2.0:1787134614.596852:0:8453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8453:1873946311947648:0@lo:502: 00000100:00100000:2.0:1787134614.596892:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134614.596915:0:8453:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb180 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.597341:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311947648 00000100:00100000:1.0:1787134614.597347:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311947648 00000100:00100000:1.0:1787134614.597371:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787134614.597377:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:8453:x1873946311947648:12345-0@lo:502: 00000100:00100000:1.0:1787134614.597611:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:8453:x1873946311947648:12345-0@lo:502: Request processed in 233us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.597619:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787134614.597821:0:8453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8453:1873946311947648:0@lo:502: 00000100:00100000:2.0:1787134614.597871:0:8453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8453:1873946311947776:0@lo:502: 00000100:00100000:2.0:1787134614.597905:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134614.597935:0:8453:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787134614.598306:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787134614.598344:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311947776 00000100:00100000:0.0:1787134614.598349:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311947776 00000100:00100000:0.0:1787134614.598370:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787134614.598377:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:8453:x1873946311947776:12345-0@lo:502: 00000100:00100000:0.0:1787134614.598580:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:8453:x1873946311947776:12345-0@lo:502: Request processed in 203us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134614.598588:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787134614.598783:0:8453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8453:1873946311947776:0@lo:502: 00000040:00080000:2.0:1787134614.598808:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787134614.600263:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787134614.600297:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787134614.600309:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.600322:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134614.600333:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787134614.600336:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787134614.600340:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787134614.600375:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.600382:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.600391:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134614.600409:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311947904:0@lo:101: 00000100:00100000:0.0:1787134614.600461:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.600503:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca480 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.600582:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311947904 00000100:00100000:3.0:1787134614.600590:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311947904 00000100:00100000:3.0:1787134614.600640:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787134614.600658:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+13:5832:x1873946311947904:12345-0@lo:101: 00010000:00010000:3.0:1787134614.600669:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134614.600682:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905de6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905ddf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.600706:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905ddf expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.600723:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905ddf expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.600744:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7aa00, rc 0) 00000100:00100000:3.0:1787134614.600792:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311947904:12345-0@lo:101: Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.600799:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787134614.600991:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311947904:0@lo:101: 00010000:00010000:2.0:1787134614.601007:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134614.601026:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134614.601081:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948032:0@lo:501: 00000100:00100000:2.0:1787134614.601132:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134614.601192:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb180 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.601302:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311948032 00000100:00100000:1.0:1787134614.601307:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311948032 00000100:00100000:1.0:1787134614.601341:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787134614.601349:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311948032:12345-0@lo:501: 00000100:00100000:1.0:1787134614.601845:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311948032:12345-0@lo:501: Request processed in 496us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.601854:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787134614.602129:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948032:0@lo:501: 00000100:00100000:2.0:1787134614.602199:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948160:0@lo:503: 00000100:00100000:2.0:1787134614.602239:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134614.602270:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787134614.602377:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311948160 00000100:00100000:0.0:1787134614.602382:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311948160 00000100:00100000:0.0:1787134614.602428:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787134614.602436:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311948160:12345-0@lo:503: 00000100:00100000:0.0:1787134614.602616:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311948160:12345-0@lo:503: Request processed in 179us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134614.602624:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787134614.602907:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948160:0@lo:503: 00000100:00100000:2.0:1787134614.603732:0:8454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8454:1873946311948288:0@lo:502: 00000100:00100000:2.0:1787134614.603783:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134614.603819:0:8454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787134614.603862:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311948288 00000100:00100000:0.0:1787134614.603867:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311948288 00000100:00100000:0.0:1787134614.603900:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787134614.603908:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:8454:x1873946311948288:12345-0@lo:502: 00000100:00100000:0.0:1787134614.604099:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:8454:x1873946311948288:12345-0@lo:502: Request processed in 183us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134614.604107:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787134614.604466:0:8454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8454:1873946311948288:0@lo:502: 00000020:01000000:2.0:1787134614.604619:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787134614.604629:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134614.604631:0:8454:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787134614.604636:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787134614.604728:0:8454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8454:1873946311948416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134614.604764:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134614.604794:0:8454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.604844:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311948416 00000100:00100000:3.0:1787134614.604849:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311948416 00000100:00100000:3.0:1787134614.604884:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787134614.604891:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:8454:x1873946311948416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134614.605034:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:8454:x1873946311948416:12345-0@lo:502:llog_process_th.0 Request processed in 143us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.605042:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787134614.605308:0:8454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8454:1873946311948416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787134614.605329:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787134614.605333:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134614.605335:0:8454:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787134614.605338:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787134614.605800:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787134614.605820:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787134614.605830:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.605842:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134614.605852:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787134614.605855:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa438c0800 from 39 10000000:01000000:0.0:1787134614.605858:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787134614.605889:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.605896:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.605915:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134614.605933:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.605971:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.606007:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca540 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.606114:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311948544 00000100:00100000:3.0:1787134614.606130:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311948544 00000100:00100000:3.0:1787134614.606298:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787134614.606308:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:5832:x1873946311948544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134614.606320:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134614.606332:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905df4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905ded expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.606355:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905ded expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.606367:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905ded expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.606377:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a800, rc 0) 00000100:00100000:3.0:1787134614.606558:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311948544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.606573:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787134614.606778:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134614.606793:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.606802:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134614.606852:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.606881:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.607584:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca540 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.607722:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311948672 00000100:00100000:3.0:1787134614.607728:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311948672 00000100:00100000:3.0:1787134614.607772:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787134614.607781:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311948672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134614.609328:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311948672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1541us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.609340:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787134614.609602:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.609731:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.609789:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.609874:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.609915:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311948800 00000100:00100000:1.0:1787134614.609921:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311948800 00000100:00100000:1.0:1787134614.609999:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787134614.610008:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311948800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134614.610250:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311948800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.610257:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787134614.610351:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311948800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787134614.611094:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8455:1873946311948928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134614.611200:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134614.611932:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787134614.612011:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311948928 00000100:00100000:0.0:1787134614.612027:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311948928 00000100:00100000:0.0:1787134614.612075:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787134614.612083:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:8455:x1873946311948928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134614.612791:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:8455:x1873946311948928:12345-0@lo:502:llog_process_th.0 Request processed in 706us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134614.612809:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787134614.612918:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8455:1873946311948928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134614.612987:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8455:1873946311949056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134614.613038:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134614.613069:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787134614.613292:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311949056 00000100:00100000:0.0:1787134614.613297:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311949056 00000100:00100000:0.0:1787134614.613321:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787134614.613327:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:8455:x1873946311949056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134614.613524:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:8455:x1873946311949056:12345-0@lo:502:llog_process_th.0 Request processed in 196us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134614.613532:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787134614.613678:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8455:1873946311949056:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787134614.613701:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787134614.613985:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787134614.614009:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787134614.614030:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.614043:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134614.614053:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787134614.614056:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787134614.614059:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787134614.614088:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.614096:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.614106:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134614.614132:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.614225:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.614257:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1787134614.614395:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311949184 00000100:00100000:2.0:1787134614.614401:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311949184 00000100:00100000:2.0:1787134614.614438:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787134614.614447:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:5832:x1873946311949184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787134614.614458:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134614.614471:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa413fc800/0x69932dacae905e02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905dfb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134614.614505:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa413fc800/0x69932dacae905e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905dfb expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134614.614516:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa413fc800/0x69932dacae905e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905dfb expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134614.614525:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa413fc800, rc 0) 00000100:00100000:2.0:1787134614.614557:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311949184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134614.614563:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787134614.614841:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134614.614854:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.614863:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134614.614922:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.614947:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.614974:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1787134614.615142:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311949312 00000100:00100000:2.0:1787134614.615155:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311949312 00000100:00100000:2.0:1787134614.615198:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787134614.615204:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311949312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787134614.615622:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311949312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 416us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134614.615630:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787134614.616029:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.616064:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.616103:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.616144:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1787134614.616346:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311949440 00000100:00100000:2.0:1787134614.616351:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311949440 00000100:00100000:2.0:1787134614.616376:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787134614.616383:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311949440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787134614.616854:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311949440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 470us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134614.616862:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787134614.617356:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134614.617971:0:8456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8456:1873946311949568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134614.618273:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134614.618304:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311949568 00000100:00100000:1.0:1787134614.618310:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311949568 00000100:00100000:1.0:1787134614.618340:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787134614.618347:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:8456:x1873946311949568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134614.618742:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:8456:x1873946311949568:12345-0@lo:502:llog_process_th.0 Request processed in 393us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.618749:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787134614.618795:0:8456:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.618811:0:8456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8456:1873946311949568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134614.618839:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134614.618847:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134614.618850:0:8456:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787134614.618855:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787134614.618879:0:8456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8456:1873946311949696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134614.618909:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134614.618929:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311949696 00000100:00100000:1.0:1787134614.618938:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311949696 00000100:00100000:1.0:1787134614.618962:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787134614.618969:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:8456:x1873946311949696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134614.619079:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:8456:x1873946311949696:12345-0@lo:502:llog_process_th.0 Request processed in 109us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.619085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787134614.619108:0:8456:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.619295:0:8456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8456:1873946311949696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134614.619314:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134614.619318:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134614.619320:0:8456:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787134614.619323:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787134614.619784:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787134614.619807:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787134614.619817:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.619829:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134614.619839:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787134614.619842:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa4da38000 from 39 10000000:01000000:0.0:1787134614.619845:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787134614.619881:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.619889:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.619898:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134614.619914:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.619953:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.619988:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.620281:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311949824 00000100:00100000:1.0:1787134614.620288:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311949824 00000100:00100000:1.0:1787134614.620317:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787134614.620324:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311949824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134614.620335:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134614.620349:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59dea200/0x69932dacae905e10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905e09 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134614.620372:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea200/0x69932dacae905e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905e09 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134614.620383:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59dea200/0x69932dacae905e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905e09 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134614.620392:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea200, rc 0) 00000100:00100000:1.0:1787134614.620873:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311949824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 547us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.620889:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787134614.620971:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134614.620985:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.620995:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134614.621055:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.621083:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.621116:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.621282:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311949952 00000100:00100000:3.0:1787134614.621288:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311949952 00000100:00100000:3.0:1787134614.621323:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787134614.621331:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311949952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134614.622056:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311949952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 724us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.622063:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787134614.622337:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311949952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.622376:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311950080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.622435:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.622610:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134614.622872:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311950080 00000100:00100000:2.0:1787134614.622878:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311950080 00000100:00100000:1.0:1787134614.622961:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787134614.622970:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311950080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134614.623295:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311950080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.623302:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787134614.623506:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311950080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.624217:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8457:1873946311950208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134614.624270:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.624783:0:8457:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca480 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.624871:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311950208 00000100:00100000:3.0:1787134614.624878:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311950208 00000100:00100000:3.0:1787134614.624909:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787134614.624917:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:8457:x1873946311950208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134614.625140:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:8457:x1873946311950208:12345-0@lo:502:llog_process_th.0 Request processed in 222us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.625155:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787134614.625309:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8457:1873946311950208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134614.625357:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8457:1873946311950336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134614.625388:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.625426:0:8457:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca480 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.625667:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311950336 00000100:00100000:3.0:1787134614.625672:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311950336 00000100:00100000:3.0:1787134614.625690:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787134614.625696:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:8457:x1873946311950336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134614.625826:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:8457:x1873946311950336:12345-0@lo:502:llog_process_th.0 Request processed in 129us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.625832:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787134614.625962:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8457:1873946311950336:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787134614.625982:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787134614.626293:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787134614.626310:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787134614.626321:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.626333:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134614.626344:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787134614.626347:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787134614.626350:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787134614.626376:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.626383:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.626392:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134614.628114:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311950464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787134614.628887:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134614.628980:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134614.629203:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311950464 00000100:00100000:2.0:1787134614.629214:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311950464 00000100:00100000:0.0:1787134614.630089:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787134614.630106:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311950464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134614.630134:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134614.630178:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa41670800/0x69932dacae905e1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905e17 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.630206:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa41670800/0x69932dacae905e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905e17 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.630218:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa41670800/0x69932dacae905e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905e17 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.630227:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa41670800, rc 0) 00000100:00100000:0.0:1787134614.630283:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311950464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134614.630290:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787134614.630869:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311950464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134614.630888:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.630906:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134614.630986:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311950592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134614.631020:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134614.631060:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.631970:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311950592 00000100:00100000:1.0:1787134614.631981:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311950592 00000100:00100000:1.0:1787134614.632035:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787134614.632044:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311950592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134614.632675:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311950592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 630us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.632683:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787134614.632862:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311950592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134614.632921:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311950720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787134614.632977:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134614.633020:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.634811:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311950720 00000100:00100000:1.0:1787134614.634858:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311950720 00000100:00100000:1.0:1787134614.634955:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787134614.634970:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311950720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134614.635438:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311950720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 470us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.635445:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787134614.636379:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311950720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.637133:0:8458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8458:1873946311950848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134614.637257:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134614.637288:0:8458:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.637421:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311950848 00000100:00100000:1.0:1787134614.637428:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311950848 00000100:00100000:1.0:1787134614.637467:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787134614.637476:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:8458:x1873946311950848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134614.637836:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:8458:x1873946311950848:12345-0@lo:502:llog_process_th.0 Request processed in 360us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.637849:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787134614.637934:0:8458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8458:1873946311950848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787134614.637959:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134614.637968:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134614.637970:0:8458:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787134614.637976:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787134614.637996:0:8458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8458:1873946311950976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134614.638026:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134614.638055:0:8458:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134614.638941:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311950976 00000100:00100000:1.0:1787134614.638950:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311950976 00000100:00100000:1.0:1787134614.638981:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787134614.638988:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:8458:x1873946311950976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134614.639248:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:8458:x1873946311950976:12345-0@lo:502:llog_process_th.0 Request processed in 259us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134614.639255:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787134614.639429:0:8458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8458:1873946311950976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787134614.639456:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134614.639462:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134614.639464:0:8458:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787134614.639470:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787134614.639941:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787134614.639967:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787134614.639978:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134614.639990:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134614.640000:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787134614.640002:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98aa6aa4b380 from 1 10000000:01000000:1.0:1787134614.640006:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787134614.640035:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134614.640044:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134614.640053:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134614.640085:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311951104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787134614.640143:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134614.640326:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787134614.642089:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311951104 00000100:00100000:3.0:1787134614.642104:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311951104 00000100:00100000:3.0:1787134614.642196:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787134614.642207:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311951104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134614.642224:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134614.642244:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7a000/0x69932dacae905e2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905e25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.642816:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7a000/0x69932dacae905e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905e25 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.642829:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7a000/0x69932dacae905e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905e25 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134614.642839:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a000, rc 0) 00000100:00100000:3.0:1787134614.642918:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311951104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 712us (2773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134614.642925:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787134614.643016:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311951104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134614.643034:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e2c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134614.643043:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e2c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134614.643111:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311951232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134614.643194:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134614.643216:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787134614.643332:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311951232 00000100:00100000:0.0:1787134614.643338:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311951232 00000100:00100000:0.0:1787134614.643377:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787134614.643385:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311951232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134614.643913:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311951232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 528us (718us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787134614.643921:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787134614.643987:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311951232:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787134614.644023:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787134614.644031:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e2c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134614.644041:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e2c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134614.976470:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134615.425925:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311951616:0@lo:400:kworker.0 00000100:00100000:0.0:1787134615.425998:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134615.426071:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787134615.426077:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311951488:0@lo:400:kworker.0 00000100:00100000:0.0:1787134615.426097:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134615.426126:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311952000:0@lo:400:kworker.0 00000100:00100000:0.0:1787134615.426151:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134615.426270:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311951360:0@lo:400:kworker.0 00000100:00100000:3.0:1787134615.426339:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311951744:0@lo:400:kworker.0 00000100:00100000:0.0:1787134615.430441:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311951616 00000100:00100000:0.0:1787134615.430461:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311951616 00000100:00100000:0.0:1787134615.430548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311951488 00000100:00100000:0.0:1787134615.430551:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311951488 00000100:00100000:0.0:1787134615.430571:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787134615.430582:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311951616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134615.431298:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311951616:12345-0@lo:400:kworker.0 Request processed in 716us (5296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134615.431307:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787134615.431342:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787134615.431364:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311951488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134615.431402:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311951488:12345-0@lo:400:kworker.0 Request processed in 40us (5304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134615.431409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787134615.431609:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311951488:0@lo:400:kworker.0 00000100:00100000:0.0:1787134615.431623:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311951616:0@lo:400:kworker.0 00000100:00080000:0.0:1787134615.431804:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134615.431898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134615.431950:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311951872:0@lo:400:kworker.0 00000100:00100000:2.0:1787134615.431993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134615.432031:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311951872 00000100:00100000:2.0:1787134615.432036:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311951872 00000100:00100000:2.0:1787134615.432085:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787134615.432092:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311951872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134615.432140:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311951872:12345-0@lo:400:kworker.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134615.432154:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787134615.432378:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134615.432398:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311951872:0@lo:400:kworker.0 00000100:00100000:0.0:1787134615.432519:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311951360 00000100:00100000:0.0:1787134615.432524:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311951360 00000100:00100000:0.0:1787134615.432561:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787134615.432568:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311951360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134615.432609:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311951360:12345-0@lo:400:kworker.0 Request processed in 42us (2964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134615.432615:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787134615.432741:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311952000 00000100:00100000:1.0:1787134615.432746:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311952000 00000100:00100000:1.0:1787134615.432794:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787134615.432801:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311952000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134615.432839:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311952000:12345-0@lo:400:kworker.0 Request processed in 39us (6687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134615.432845:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787134615.432921:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134615.433071:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311951744 00000100:00100000:2.0:1787134615.433075:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311951744 00000100:00100000:2.0:1787134615.433108:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787134615.433126:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311951744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134615.433315:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311951744:12345-0@lo:400:kworker.0 Request processed in 192us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134615.433323:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787134615.433366:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311951360:0@lo:400:kworker.0 00000100:00080000:0.0:1787134615.433488:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134615.433492:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787134615.433518:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d2300 x1873946311952000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134615.433529:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311952000:0@lo:400:kworker.0 00010000:00080000:3.0:1787134615.433609:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d3b80 x1873946311951744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134615.433619:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311951744:0@lo:400:kworker.0 00000100:00100000:2.0:1787134615.936408:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134615.938230:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311952128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134615.938319:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134615.941027:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311952128 00000100:00100000:3.0:1787134615.941047:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311952128 00000100:00100000:3.0:1787134615.941143:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787134615.941155:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311952128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134615.941228:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134615.941325:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311952128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134615.941332:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787134615.941576:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f77a680 x1873946311952128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134615.941598:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311952128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134616.000450:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134617.025022:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134617.333223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134617.333619:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287805184 00000100:00100000:3.0:1787134617.333631:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287805184 00000100:00100000:3.0:1787134617.333716:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 165 00000100:00100000:3.0:1787134617.333726:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:5593:x1873946287805184:12345-192.168.202.36@tcp:101: 00010000:00010000:3.0:1787134617.333741:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134617.333758:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7ba00/0x69932dacae905e33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac90701f3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134617.333785:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7ba00/0x69932dacae905e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701f3 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134617.333805:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7ba00/0x69932dacae905e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701f3 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134617.333813:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7ba00, rc 0) 00000100:00100000:3.0:1787134617.333878:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5593:x1873946287805184:12345-192.168.202.36@tcp:101: Request processed in 153us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134617.333885:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 165 00000100:00100000:1.0:1787134617.349783:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134617.350089:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287805312 00000100:00100000:2.0:1787134617.350109:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287805312 00000100:00100000:2.0:1787134617.350188:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 166 00000100:00100000:2.0:1787134617.350197:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5593:x1873946287805312:12345-192.168.202.36@tcp:501: 00000100:00100000:2.0:1787134617.350874:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5593:x1873946287805312:12345-192.168.202.36@tcp:501: Request processed in 675us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134617.350883:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 166 00000100:00100000:1.0:1787134617.355948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134617.356019:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287805440 00000100:00100000:3.0:1787134617.356030:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287805440 00000100:00100000:3.0:1787134617.356103:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 167 00000100:00100000:3.0:1787134617.356114:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5593:x1873946287805440:12345-192.168.202.36@tcp:503: 00000100:00100000:3.0:1787134617.356367:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5593:x1873946287805440:12345-192.168.202.36@tcp:503: Request processed in 254us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134617.356380:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 167 00000100:00100000:0.0:1787134617.360232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134617.360440:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287805568 00000100:00100000:2.0:1787134617.360460:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287805568 00000100:00100000:2.0:1787134617.360513:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00100000:2.0:1787134617.360524:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:6079:x1873946287805568:12345-192.168.202.36@tcp:502: 00000100:00100000:2.0:1787134617.363016:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:6079:x1873946287805568:12345-192.168.202.36@tcp:502: Request processed in 2481us (2779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134617.363032:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00100000:1.0:1787134617.378341:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134617.378937:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287805696 00000100:00100000:0.0:1787134617.378949:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287805696 00000100:00100000:0.0:1787134617.379030:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 169 00000100:00100000:0.0:1787134617.379040:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:6079:x1873946287805696:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787134617.379354:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:6079:x1873946287805696:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 315us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134617.379362:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 169 00000100:00100000:1.0:1787134617.395489:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134617.396189:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287805824 00000100:00100000:2.0:1787134617.396204:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287805824 00000100:00100000:2.0:1787134617.396273:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 170 00000100:00100000:2.0:1787134617.396283:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5593:x1873946287805824:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787134617.396300:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134617.396322:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa413fd800/0x69932dacae905e3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac90701fa expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134617.396350:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa413fd800/0x69932dacae905e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701fa expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134617.396363:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa413fd800/0x69932dacae905e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701fa expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134617.396374:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa413fd800, rc 0) 00000100:00100000:2.0:1787134617.396457:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5593:x1873946287805824:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 175us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134617.396464:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 170 00000100:00100000:1.0:1787134617.400909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134617.401004:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287805952 00000100:00100000:0.0:1787134617.401015:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287805952 00000100:00100000:0.0:1787134617.401083:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 171 00000100:00100000:0.0:1787134617.401104:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5593:x1873946287805952:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134617.401449:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5593:x1873946287805952:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 356us (549us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787134617.401458:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 171 00010000:00010000:0.0:1787134618.049485:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787134618.310446:0:8497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd01de5f0 20000000:00000080:1.0:1787134618.310466:0:8497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98aa81e7d400 uarg=0000000000000000 20000000:01000000:1.0:1787134618.310505:0:8497:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787134618.310512:0:8497:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787134618.310516:0:8497:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787134618.311757:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787134618.311936:0:8497:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787134618.319637:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787134618.319699:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787134618.319750:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787134618.319766:0:8497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787134618.319785:0:8497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.319802:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa40030e00/0x69932dacae905bb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905baf expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.319810:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905c11 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.319816:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905cdc expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.319834:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701c2 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.319841:0:8497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.319882:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90701c2 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.319897:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90701c2 expref: 9 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134618.319913:0:8497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1873946311952256:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134618.320203:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905cdc expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320211:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905cdc expref: 18 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134618.320221:0:8497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1873946311952384:0@lo:104: 00000100:00100000:0.0:1787134618.320263:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787134618.320303:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905c11 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320312:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905c11 expref: 18 pid: 5829 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134618.320321:0:8497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1873946311952512:0@lo:104: 00000100:00100000:0.0:1787134618.320417:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134618.320456:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787134618.320468:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311952384 00000100:00100000:0.0:1787134618.320475:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311952384 00000100:00100000:0.0:1787134618.320512:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311952512 00000100:00100000:0.0:1787134618.320515:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311952512 00000100:00100000:0.0:1787134618.320530:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787134618.320538:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:8497:x1873946311952384:12345-0@lo:104: 00010000:00010000:0.0:1787134618.320554:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320606:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787134618.320612:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:8497:x1873946311952384:12345-0@lo:104: Request processed in 75us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134618.320620:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787134618.320640:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787134618.320646:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6f885450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:8497:x1873946311952512:12345-0@lo:104: 00010000:00010000:0.0:1787134618.320654:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320686:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787134618.320691:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6f885450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:8497:x1873946311952512:12345-0@lo:104: Request processed in 46us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134618.320696:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787134618.320737:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787134618.320745:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320752:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134618.320763:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320771:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134618.320778:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134618.320784:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787134618.320814:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320821:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134618.320844:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320850:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa59deb800/0x69932dacae905cdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ce3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320864:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134618.320867:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320873:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa821c4400 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134618.320875:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320881:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134618.320898:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134618.320903:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787134618.320916:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.320922:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134618.320928:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134618.321333:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311952640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134618.321378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134618.321404:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134618.321410:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311952768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134618.321428:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134618.321455:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311952640 00000100:00100000:3.0:1787134618.321460:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311952640 00010000:00010000:3.0:1787134618.321479:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905cdc expref: 19 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134618.321497:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311952768 00000100:00100000:3.0:1787134618.321500:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311952768 00010000:00010000:3.0:1787134618.321511:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c11 expref: 20 pid: 5829 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134618.321528:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787134618.321535:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+20:3307:x1873946311952640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134618.321547:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134618.321553:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905cdc expref: 20 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.321564:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905cdc expref: 20 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.321587:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134618.321615:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+20:3307:x1873946311952640:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134618.321634:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787134618.321649:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787134618.321655:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311952768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134618.321663:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134618.321667:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905c11 expref: 19 pid: 5829 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.321675:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905c11 expref: 19 pid: 5829 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.321685:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134618.321706:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311952768:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134618.321712:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787134618.321753:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311952768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134618.321761:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311952640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787134618.322592:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa821c4400/0x69932dacae905c11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905c18 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.322606:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134618.322608:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134618.322610:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134618.322617:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134618.322671:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa40030e00/0x69932dacae905bb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905baf expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.322682:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa40030e00/0x69932dacae905bb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905baf expref: 18 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134618.322695:0:8497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1873946311952896:0@lo:104: 00000100:00100000:0.0:1787134618.322734:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134618.322757:0:8497:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa438a3180 going to sleep for 11 seconds 00010000:00010000:0.0:1787134618.322773:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa40031400/0x69932dacae905ce3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905cdc expref: 18 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134618.322793:0:8497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1873946311952384:0@lo:104: 00010000:00010000:0.0:1787134618.322803:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa821c5c00/0x69932dacae905c18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905c11 expref: 17 pid: 5829 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134618.322810:0:8497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1873946311952512:0@lo:104: 00000100:00100000:2.0:1787134618.322870:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311952896 00000100:00100000:2.0:1787134618.322875:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311952896 00000100:00100000:2.0:1787134618.322915:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787134618.322930:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:8497:x1873946311952896:12345-0@lo:104: 00010000:00010000:2.0:1787134618.322941:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134618.322979:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787134618.322984:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:8497:x1873946311952896:12345-0@lo:104: Request processed in 57us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134618.322990:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787134618.324884:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134618.324898:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.324910:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa821c4600 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134618.324914:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.324926:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134618.324934:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134618.324940:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787134618.325001:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.325008:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134618.325108:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.325116:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa821c4600/0x69932dacae905baf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905bb6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.325152:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134618.325153:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134618.325176:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134618.325220:0:8497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1873946311952896:0@lo:104: 00000100:00100000:1.0:1787134618.325352:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311953024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787134618.325408:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134618.325544:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311953024 00000100:00100000:0.0:1787134618.325551:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311953024 00010000:00010000:0.0:1787134618.325582:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa40030e00/0x69932dacae905bb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905baf expref: 17 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134618.325630:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787134618.325639:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:3309:x1873946311953024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787134618.325653:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134618.325658:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa40030e00/0x69932dacae905bb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905baf expref: 17 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.325668:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa40030e00/0x69932dacae905bb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905baf expref: 17 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.325683:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa40030e00/0x69932dacae905bb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905baf expref: 17 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134618.325697:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134618.325730:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:3309:x1873946311953024:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134618.325737:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787134618.326021:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311953024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787134618.326651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134618.326711:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287806080 00000100:00100000:3.0:1787134618.326716:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287806080 00010000:00010000:3.0:1787134618.326741:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90701c2 expref: 10 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134618.326774:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:3.0:1787134618.326782:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2351:x1873946287806080:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134618.326796:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134618.326801:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90701c2 expref: 10 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326829:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90701c2 expref: 10 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326846:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326855:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326869:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326877:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326884:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326890:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326897:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134618.326901:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326909:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326918:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.326941:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134618.326998:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2351:x1873946287806080:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 216us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134618.327006:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 24 00010000:00010000:0.0:1787134618.335679:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa41671800/0x69932dacae905da0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90701c2 expref: 9 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134618.335740:0:8497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1873946311952256:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134618.335786:0:8497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134618.337443:0:8497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134618.337461:0:8497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134618.337467:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa81450200/0x69932dacae905e41 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134618.713747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134618.713862:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287806208 00000100:00100000:3.0:1787134618.713875:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287806208 00000100:00100000:3.0:1787134618.713940:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:3.0:1787134618.713951:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:5593:x1873946287806208:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134618.713973:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134618.713996:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070201 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.714029:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070201 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.714042:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070201 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134618.714054:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7bc00, rc 0) 00000100:00100000:3.0:1787134618.714239:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5593:x1873946287806208:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 289us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134618.714247:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:2.0:1787134618.724991:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134618.725403:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287806336 00000100:00100000:0.0:1787134618.725593:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287806336 00000100:00100000:0.0:1787134618.725729:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:0.0:1787134618.725742:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5593:x1873946287806336:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134618.726119:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5593:x1873946287806336:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 379us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134618.726128:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:1.0:1787134618.729636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134618.729838:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287806464 00000100:00100000:0.0:1787134618.729852:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287806464 00000100:00100000:0.0:1787134618.729927:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 174 00000100:00100000:0.0:1787134618.729938:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5593:x1873946287806464:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134618.730745:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:5593:x1873946287806464:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 803us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134618.730757:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 174 00000100:00100000:1.0:1787134618.735820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134618.736389:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287806592 00000100:00100000:0.0:1787134618.736403:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287806592 00000100:00100000:0.0:1787134618.736572:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 175 00000100:00100000:0.0:1787134618.736586:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:6125:x1873946287806592:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787134618.736853:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:6125:x1873946287806592:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 270us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134618.736872:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 175 00000100:00100000:2.0:1787134618.744029:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134618.744348:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287806720 00000100:00100000:3.0:1787134618.744359:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287806720 00000100:00100000:3.0:1787134618.744505:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 176 00000100:00100000:3.0:1787134618.744517:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:6125:x1873946287806720:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787134618.744794:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:6125:x1873946287806720:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 280us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134618.744803:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 176 00000100:00100000:1.0:1787134618.873605:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134618.873669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134618.877777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134618.878053:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287806848 00000100:00100000:0.0:1787134618.878070:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287806848 00000100:00100000:0.0:1787134618.878210:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:0.0:1787134618.878226:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287806848:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134618.878367:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287806848:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 145us (4780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134618.878375:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00080000:0.0:1787134618.878406:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134618.879937:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287807104 00000100:00100000:3.0:1787134618.879958:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287807104 00000100:00100000:3.0:1787134618.880072:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287806976 00000100:00100000:3.0:1787134618.880086:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287806976 00000100:00100000:3.0:1787134618.880132:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:3.0:1787134618.880145:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287807104:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134618.880284:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287807104:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 140us (6613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134618.880295:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:3.0:1787134618.880320:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:3.0:1787134618.880328:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287806976:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134618.880355:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287806976:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134618.880362:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00080000:0.0:1787134618.881806:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134618.881838:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787134619.008649:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134619.008681:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311953152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134619.008796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134619.008933:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311953152 00000100:00100000:3.0:1787134619.008946:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311953152 00000100:00100000:3.0:1787134619.009040:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787134619.009053:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311953152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134619.009111:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134619.009213:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311953152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134619.009222:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787134619.009527:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787134619.009583:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6fc1b100 x1873946311953152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134619.009614:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311953152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787134619.073149:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787134620.032300:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787134620.032308:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa52a7d800 from 4 10000000:01000000:1.0:1787134620.032314:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787134620.032361:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.032375:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.032386:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134620.032414:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311953280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.032503:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134620.032555:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134620.032678:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311953280 00000100:00100000:0.0:1787134620.032688:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311953280 00000100:00100000:0.0:1787134620.032741:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787134620.032752:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311953280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134620.032767:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134620.032782:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905e4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134620.032807:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905e4f expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134620.032818:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905e4f expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134620.032828:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451200, rc 0) 00000100:00100000:0.0:1787134620.032886:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311953280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134620.032895:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787134620.032922:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311953280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134620.032942:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134620.032953:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134620.033007:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311953408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134620.033048:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134620.033082:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457afb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.033151:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311953408 00000100:00100000:1.0:1787134620.033386:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311953408 00000100:00100000:1.0:1787134620.033423:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787134620.033431:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311953408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.033860:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311953408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 429us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.033869:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787134620.033932:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311953408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134620.033979:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311953536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787134620.034033:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134620.034083:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457afb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787134620.034374:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311953536 00000100:00100000:0.0:1787134620.034380:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311953536 00000100:00100000:0.0:1787134620.034484:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787134620.034494:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311953536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134620.034689:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311953536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134620.034697:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787134620.034769:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311953536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787134620.035382:0:8563:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8563:1873946311953664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134620.035430:0:8563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134620.035702:0:8563:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.035746:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311953664 00000100:00100000:1.0:1787134620.035753:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311953664 00000100:00100000:1.0:1787134620.035784:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787134620.035792:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:8563:x1873946311953664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134620.036265:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:8563:x1873946311953664:12345-0@lo:502:llog_process_th.0 Request processed in 224us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.036449:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787134620.036672:0:8563:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8563:1873946311953664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787134620.036709:0:8563:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134620.036720:0:8563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134620.036723:0:8563:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787134620.036732:0:8563:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa52a7d800 00000020:00000080:3.0:1787134620.036735:0:8563:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787134620.036840:0:8563:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8563:1873946311953792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134620.036893:0:8563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134620.036921:0:8563:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457afd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787134620.036993:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311953792 00000100:00100000:2.0:1787134620.036999:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311953792 00000100:00100000:2.0:1787134620.037040:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787134620.037051:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:8563:x1873946311953792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134620.037371:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:8563:x1873946311953792:12345-0@lo:502:llog_process_th.0 Request processed in 320us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134620.037380:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787134620.037391:0:8563:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8563:1873946311953792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787134620.037416:0:8563:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134620.037421:0:8563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134620.037423:0:8563:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787134620.037427:0:8563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787134620.037628:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787134620.037649:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787134620.037660:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134620.037679:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134620.037691:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787134620.037694:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa438c0800 from 4 10000000:01000000:2.0:1787134620.037697:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787134620.037724:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134620.037732:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134620.037742:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134620.037756:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311953920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787134620.037787:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134620.037813:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa480f5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.041997:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311953920 00000100:00100000:1.0:1787134620.042024:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311953920 00000100:00100000:1.0:1787134620.042104:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787134620.042115:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311953920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134620.042134:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134620.042152:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905e5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.043358:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905e5d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.043373:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905e5d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.043383:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea000, rc 0) 00000100:00100000:1.0:1787134620.043634:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311953920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1519us (5843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.043643:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787134620.043745:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311953920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134620.043766:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.043775:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134620.043844:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.043882:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134620.043910:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749240 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.043925:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311954048 00000100:00100000:1.0:1787134620.043929:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311954048 00000100:00100000:1.0:1787134620.043955:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787134620.043962:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311954048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.046679:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311954048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2704us (2783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.046695:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787134620.046789:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134620.046841:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134620.046885:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134620.046912:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5075b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.046959:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311954176 00000100:00100000:1.0:1787134620.046966:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311954176 00000100:00100000:1.0:1787134620.047006:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787134620.047014:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311954176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.048146:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311954176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1128us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.048183:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787134620.056312:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.061910:0:8566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8566:1873946311954304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134620.062408:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134620.062461:0:8566:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134620.062749:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311954304 00000100:00100000:3.0:1787134620.062760:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311954304 00000100:00100000:3.0:1787134620.062817:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787134620.062827:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:8566:x1873946311954304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134620.065417:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:8566:x1873946311954304:12345-0@lo:502:llog_process_th.0 Request processed in 2583us (3001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134620.065432:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787134620.065740:0:8566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8566:1873946311954304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134620.065778:0:8566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134620.065789:0:8566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134620.065792:0:8566:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787134620.065799:0:8566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa438c0800 00000020:00000080:1.0:1787134620.065802:0:8566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787134620.067185:0:8566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8566:1873946311954432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134620.067644:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134620.067689:0:8566:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134620.068733:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311954432 00000100:00100000:3.0:1787134620.068748:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311954432 00000100:00100000:3.0:1787134620.068816:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787134620.068828:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:8566:x1873946311954432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134620.069095:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:8566:x1873946311954432:12345-0@lo:502:llog_process_th.0 Request processed in 269us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134620.069103:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787134620.070100:0:8566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8566:1873946311954432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134620.070142:0:8566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134620.070152:0:8566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134620.070178:0:8566:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787134620.070185:0:8566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787134620.070537:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787134620.070563:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787134620.070575:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134620.070589:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134620.070609:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787134620.070612:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa4da38000 from 4 10000000:01000000:3.0:1787134620.070615:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787134620.070659:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134620.070667:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134620.070677:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134620.070701:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787134620.070764:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134620.070816:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457af840 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.071038:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311954560 00000100:00100000:1.0:1787134620.071137:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311954560 00000100:00100000:1.0:1787134620.071295:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787134620.071305:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311954560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134620.071317:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134620.071331:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905e6b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.071354:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905e6b expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.071364:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905e6b expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.071373:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea800, rc 0) 00000100:00100000:1.0:1787134620.071409:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311954560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.071415:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787134620.071561:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134620.071575:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134620.071585:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134620.071631:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134620.071655:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134620.071681:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457af840 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.072246:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311954688 00000100:00100000:1.0:1787134620.072253:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311954688 00000100:00100000:1.0:1787134620.072278:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787134620.072285:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311954688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.073344:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311954688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1052us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.073355:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787134620.073407:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.073451:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.073507:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134620.073532:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311954816 00000100:00100000:1.0:1787134620.073536:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311954816 00000100:00100000:1.0:1787134620.073559:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787134620.073565:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311954816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.073710:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311954816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.073717:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787134620.073756:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749600 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.073768:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311954816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134620.073923:0:8568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8568:1873946311954944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134620.073963:0:8568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134620.073980:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311954944 00000100:00100000:1.0:1787134620.073983:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311954944 00000100:00100000:1.0:1787134620.074000:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787134620.074005:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:8568:x1873946311954944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134620.074133:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:8568:x1873946311954944:12345-0@lo:502:llog_process_th.0 Request processed in 126us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.074140:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787134620.074187:0:8568:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.074198:0:8568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8568:1873946311954944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134620.074215:0:8568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134620.074225:0:8568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134620.074228:0:8568:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787134620.074239:0:8568:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa4da38000 00000020:00000080:1.0:1787134620.074241:0:8568:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787134620.074587:0:8568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8568:1873946311955072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134620.074617:0:8568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134620.074634:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311955072 00000100:00100000:1.0:1787134620.074638:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311955072 00000100:00100000:1.0:1787134620.074655:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787134620.074660:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:8568:x1873946311955072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134620.074771:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:8568:x1873946311955072:12345-0@lo:502:llog_process_th.0 Request processed in 109us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134620.074778:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787134620.074805:0:8568:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134620.074816:0:8568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:8568:1873946311955072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134620.074831:0:8568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134620.074835:0:8568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134620.074837:0:8568:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787134620.074842:0:8568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787134620.074884:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787134620.074901:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787134620.074910:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134620.074921:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134620.100728:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134620.545462:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311955328:0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.545537:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134620.545601:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787134620.545607:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311955200:0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.545632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134620.545652:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311955712:0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.545689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134620.545724:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311955456:0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.545762:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134620.545782:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134620.545787:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311955584:0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.545809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134620.545838:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311955328 00000100:00100000:2.0:1787134620.545845:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311955328 00000100:00100000:2.0:1787134620.545892:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311955200 00000100:00100000:2.0:1787134620.545895:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311955200 00000100:00100000:2.0:1787134620.545906:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311955584 00000100:00100000:2.0:1787134620.545908:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311955584 00000100:00100000:2.0:1787134620.545924:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787134620.545932:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311955328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.545989:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311955328:12345-0@lo:400:kworker.0 Request processed in 57us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134620.545997:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787134620.546018:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787134620.546024:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311955200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.546049:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311955200:12345-0@lo:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134620.546055:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787134620.546079:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787134620.546085:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311955584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.546114:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311955584:12345-0@lo:400:kworker.0 Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134620.546119:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787134620.546136:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311955712 00000100:00100000:2.0:1787134620.546139:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311955712 00000100:00100000:2.0:1787134620.546209:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311955456 00000100:00100000:2.0:1787134620.546213:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311955456 00000100:00100000:2.0:1787134620.546232:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787134620.546238:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311955712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.546270:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311955712:12345-0@lo:400:kworker.0 Request processed in 32us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134620.546277:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787134620.546287:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787134620.546293:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311955456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.546319:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311955456:12345-0@lo:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134620.546325:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787134620.546346:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787134620.546351:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134620.546393:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311955584:0@lo:400:kworker.0 00010000:00080000:2.0:1787134620.546407:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d2d80 x1873946311955456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134620.546418:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311955456:0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.546449:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311955200:0@lo:400:kworker.0 00010000:00080000:2.0:1787134620.546459:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d3480 x1873946311955712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134620.546468:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311955712:0@lo:400:kworker.0 00000100:00100000:2.0:1787134620.546478:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311955328:0@lo:400:kworker.0 00000100:00100000:2.0:1787134621.057375:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311955840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134621.057471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134621.057597:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311955840 00000100:00100000:3.0:1787134621.057607:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311955840 00000100:00100000:3.0:1787134621.057681:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787134621.057691:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311955840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134621.057734:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134621.057982:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311955840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 291us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134621.057991:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787134621.058149:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f77a300 x1873946311955840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134621.058261:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311955840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134621.120571:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134622.144907:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134623.168408:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134623.999343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134623.999388:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134623.999420:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134623.999568:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287807360 00000100:00100000:0.0:1787134623.999581:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287807360 00000100:00100000:0.0:1787134623.999657:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:0.0:1787134623.999670:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287807360:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134623.999766:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287807360:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 99us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134623.999774:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:2.0:1787134624.000326:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134624.000355:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287807616 00000100:00100000:2.0:1787134624.000362:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287807616 00000100:00100000:2.0:1787134624.000393:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287807488 00000100:00100000:2.0:1787134624.000397:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287807488 00000100:00100000:2.0:1787134624.000419:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:2.0:1787134624.000427:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287807616:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134624.000548:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287807616:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 122us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134624.000555:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:2.0:1787134624.000572:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:2.0:1787134624.000578:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2350:x1873946287807488:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134624.000602:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2350:x1873946287807488:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 25us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134624.000608:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:2.0:1787134624.000627:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287807232 00000100:00100000:2.0:1787134624.000639:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287807232 00000100:00100000:2.0:1787134624.000665:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 192 00000100:00100000:2.0:1787134624.000671:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2350:x1873946287807232:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134624.000698:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2350:x1873946287807232:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134624.000705:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 192 00000100:00080000:2.0:1787134624.000732:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787134624.000737:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787134624.000739:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134624.134532:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311955968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787134624.134622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134624.135466:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311955968 00000100:00100000:1.0:1787134624.135480:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311955968 00000100:00100000:1.0:1787134624.135546:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787134624.135555:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311955968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134624.135599:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787134624.138488:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787134624.138885:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311955968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3323us (4255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134624.138903:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787134624.139104:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d3b80 x1873946311955968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134624.139132:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311955968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787134624.193858:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134625.237155:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134625.664460:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311956224:0@lo:400:kworker.0 00000100:00100000:0.0:1787134625.664539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134625.664618:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311956736:0@lo:400:kworker.0 00000100:00100000:0.0:1787134625.664648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134625.664680:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134625.664686:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311956352:0@lo:400:kworker.0 00000100:00100000:0.0:1787134625.664708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134625.665001:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311956224 00000100:00100000:0.0:1787134625.665010:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311956224 00000100:00100000:1.0:1787134625.665203:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311956096:0@lo:400:kworker.0 00000100:00100000:1.0:1787134625.665248:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134625.665276:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311956608:0@lo:400:kworker.0 00000100:00100000:1.0:1787134625.665301:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134625.665522:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311956480:0@lo:400:kworker.0 00000100:00100000:3.0:1787134625.665570:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134625.665761:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311956736 00000100:00100000:3.0:1787134625.665768:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311956736 00000100:00100000:3.0:1787134625.665819:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311956480 00000100:00100000:3.0:1787134625.665822:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311956480 00000100:00100000:3.0:1787134625.665848:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787134625.665858:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311956736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134625.665922:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311956736:12345-0@lo:400:kworker.0 Request processed in 62us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134625.665930:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787134625.665950:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787134625.665956:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311956480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134625.665989:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311956480:12345-0@lo:400:kworker.0 Request processed in 34us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134625.666006:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787134625.666040:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787134625.666083:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d2300 x1873946311956736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134625.666098:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311956736:0@lo:400:kworker.0 00010000:00080000:3.0:1787134625.666130:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d1880 x1873946311956480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134625.666139:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311956480:0@lo:400:kworker.0 00000100:00100000:1.0:1787134625.675908:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311956096 00000100:00100000:1.0:1787134625.675924:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311956096 00000100:00100000:1.0:1787134625.675989:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787134625.675999:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311956096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134625.676095:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311956096:12345-0@lo:400:kworker.0 Request processed in 97us (10845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134625.676102:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787134625.676183:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311956096:0@lo:400:kworker.0 00000100:00100000:0.0:1787134625.677491:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311956352 00000100:00100000:0.0:1787134625.677503:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311956352 00000100:00100000:0.0:1787134625.677550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311956608 00000100:00100000:0.0:1787134625.677552:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311956608 00000100:00100000:0.0:1787134625.677586:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787134625.677594:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311956224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134625.677666:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311956224:12345-0@lo:400:kworker.0 Request processed in 73us (13127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134625.677673:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787134625.677688:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787134625.677694:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311956352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134625.677717:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311956352:12345-0@lo:400:kworker.0 Request processed in 24us (13008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134625.677723:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787134625.677732:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787134625.677737:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311956608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134625.677760:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311956608:12345-0@lo:400:kworker.0 Request processed in 23us (12459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134625.677779:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787134625.678010:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134625.678056:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311956608:0@lo:400:kworker.0 00000100:00100000:0.0:1787134625.680677:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311956352:0@lo:400:kworker.0 00000100:00100000:0.0:1787134625.680698:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311956224:0@lo:400:kworker.0 00000001:02000400:3.0:1787134626.112223:0:8797:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1787134626.189123:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311956864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134626.189236:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134626.189334:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311956864 00000100:00100000:2.0:1787134626.189343:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311956864 00000100:00100000:2.0:1787134626.189399:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787134626.189410:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311956864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787134626.189452:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134626.189499:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311956864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134626.189509:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787134626.189556:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d2a00 x1873946311956864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134626.189578:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311956864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787134626.245734:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134627.266277:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134628.295284:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134629.117326:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134629.117378:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134629.117419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287807872 00000100:00100000:3.0:1787134629.117430:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287807872 00000100:00080000:1.0:1787134629.117482:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134629.117617:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:3.0:1787134629.120110:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287807872:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134629.120238:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287807872:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 144us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134629.120248:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:2.0:1787134629.120490:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287807744 00000100:00100000:2.0:1787134629.120500:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287807744 00000100:00100000:2.0:1787134629.120630:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 194 00000100:00100000:2.0:1787134629.120645:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2350:x1873946287807744:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134629.120856:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2350:x1873946287807744:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 211us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134629.120863:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 194 00000100:00100000:1.0:1787134629.121559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134629.121602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134629.121683:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287808000 00000100:00100000:0.0:1787134629.121691:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287808000 00000100:00100000:0.0:1787134629.121769:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287808128 00000100:00100000:0.0:1787134629.121773:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287808128 00000100:00080000:1.0:1787134629.121798:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787134629.121802:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134629.121875:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787134629.121883:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2348:x1873946287808000:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:0.0:1787134629.121916:0:6682:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905dae 00000100:00080000:0.0:1787134629.121926:0:6682:0:(import.c:65:import_set_state_nolock()) ffff98aa55106800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787134629.121965:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787134629.122364:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+2:2348:x1873946287808000:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 479us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134629.122371:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787134629.122386:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:0.0:1787134629.122392:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2348:x1873946287808128:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:0.0:1787134629.122407:0:6682:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905db5 00000100:00080000:0.0:1787134629.122413:0:6682:0:(import.c:65:import_set_state_nolock()) ffff98aa6f89c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787134629.122432:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787134629.122607:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+2:2348:x1873946287808128:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 213us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134629.122614:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00010000:00010000:0.0:1787134629.122689:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134629.122695:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134629.250690:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311956992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134629.250770:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134629.252733:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311956992 00000100:00100000:2.0:1787134629.252746:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311956992 00000100:00100000:2.0:1787134629.252815:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787134629.252825:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311956992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787134629.252860:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134629.252930:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311956992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134629.252938:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787134629.252994:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6fc19880 x1873946311956992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134629.253014:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311956992:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787134629.253185:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787134629.319947:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134630.336493:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134630.784870:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311957504:0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.784962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134630.785053:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787134630.785060:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311957120:0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.785092:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134630.785118:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311957632:0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.785178:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134630.785211:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311957248:0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.785236:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134630.785256:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311957760:0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.785303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134630.785325:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134630.785331:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311957376:0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.785518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134630.785560:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311957504 00000100:00100000:0.0:1787134630.785571:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311957504 00000100:00100000:0.0:1787134630.785621:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311957760 00000100:00100000:0.0:1787134630.785624:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311957760 00000100:00100000:0.0:1787134630.785657:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787134630.785666:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311957504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.785723:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311957504:12345-0@lo:400:kworker.0 Request processed in 58us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134630.785731:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787134630.785747:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787134630.785752:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311957760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.785806:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311957760:12345-0@lo:400:kworker.0 Request processed in 53us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134630.785811:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787134630.785831:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311957120 00000100:00100000:0.0:1787134630.785835:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311957120 00000100:00100000:0.0:1787134630.785860:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787134630.785867:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311957120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.785895:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311957120:12345-0@lo:400:kworker.0 Request processed in 29us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134630.785901:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787134630.785928:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311957632 00000100:00100000:0.0:1787134630.785932:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311957632 00000100:00100000:0.0:1787134630.785950:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311957248 00000100:00100000:0.0:1787134630.785952:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311957248 00000100:00100000:0.0:1787134630.785961:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311957376 00000100:00100000:0.0:1787134630.785964:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311957376 00000100:00100000:0.0:1787134630.785991:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787134630.785997:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311957632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.786027:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311957632:12345-0@lo:400:kworker.0 Request processed in 31us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134630.786033:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787134630.786043:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787134630.786048:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311957248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.786072:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311957248:12345-0@lo:400:kworker.0 Request processed in 24us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134630.786078:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787134630.786087:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787134630.786100:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311957376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.786130:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311957376:12345-0@lo:400:kworker.0 Request processed in 30us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134630.786135:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787134630.786301:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787134630.786308:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134630.786704:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311957376:0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.786720:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311957248:0@lo:400:kworker.0 00010000:00080000:0.0:1787134630.786733:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d2300 x1873946311957760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134630.786742:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311957760:0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.788861:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311957120:0@lo:400:kworker.0 00000100:00100000:0.0:1787134630.788888:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311957632:0@lo:400:kworker.0 00010000:00080000:0.0:1787134630.788903:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d0e00 x1873946311957504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134630.788915:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311957504:0@lo:400:kworker.0 00000100:00100000:1.0:1787134631.297641:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787134631.297676:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311957888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134631.297778:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134631.297978:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311957888 00000100:00100000:2.0:1787134631.297989:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311957888 00000100:00100000:2.0:1787134631.298061:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787134631.298074:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311957888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787134631.298122:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134631.298221:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311957888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134631.298230:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787134631.298308:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942761180 x1873946311957888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134631.298332:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311957888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787134631.363083:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787134631.376555:0:9040:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing yml_node 00000001:00100000:0.0:1787134632.381929:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:0.0:1787134632.381940:0:7632:0:(genops.c:906:class_export_put()) final put ffff98aa6f89a000/486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:3.0:1787134632.382022:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6f89a000/486fb1ad-4266-4864-b299-111c5140734b for lustre-OST0001 00000020:00000080:3.0:1787134632.382078:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa6f89c800 for lustre-OST0001 00010000:00010000:0.0:1787134632.384553:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787134632.918815:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:0.0:1787134632.918828:0:6707:0:(genops.c:906:class_export_put()) final put ffff98aa55107800/486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:2.0:1787134632.919730:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa55107800/486fb1ad-4266-4864-b299-111c5140734b for lustre-OST0000 00000020:00000080:2.0:1787134632.924311:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa55106800 for lustre-OST0000 00010000:00010000:1.0:1787134633.413856:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134634.231297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134634.231353:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134634.231529:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287808256 00000100:00100000:1.0:1787134634.231541:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287808256 00000100:00100000:1.0:1787134634.231608:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 196 00000100:00100000:1.0:1787134634.231617:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2350:x1873946287808256:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134634.231818:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287808384 00000100:00100000:1.0:1787134634.231822:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2350:x1873946287808256:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 205us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134634.231822:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287808384 00000100:00100000:1.0:1787134634.231829:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 196 00000100:00100000:0.0:1787134634.231891:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:0.0:1787134634.231899:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287808384:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134634.231931:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287808384:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 33us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134634.231948:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00080000:3.0:1787134634.232100:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134634.368822:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311958016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134634.368899:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134634.369102:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311958016 00000100:00100000:2.0:1787134634.369113:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311958016 00000100:00080000:3.0:1787134634.369179:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134634.369194:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787134634.369205:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311958016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787134634.369239:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134634.378573:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311958016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9359us (9661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134634.378591:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787134634.380036:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6fc19c00 x1873946311958016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134634.380073:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311958016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787134634.432808:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134635.456716:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134635.905770:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311958400:0@lo:400:kworker.0 00000100:00100000:3.0:1787134635.905853:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134635.905965:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787134635.905972:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311958272:0@lo:400:kworker.0 00000100:00100000:3.0:1787134635.905998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134635.906028:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311958784:0@lo:400:kworker.0 00000100:00100000:3.0:1787134635.906060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134635.906100:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311958784 00000100:00100000:3.0:1787134635.906109:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311958784 00000100:00100000:3.0:1787134635.906197:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787134635.906208:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311958784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.906311:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311958144:0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.906344:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134635.906364:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311958656:0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.906383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134635.906399:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787134635.906403:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311958528:0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.906419:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134635.906449:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311958400 00000100:00100000:1.0:1787134635.906452:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311958400 00000100:00100000:1.0:1787134635.906473:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311958272 00000100:00100000:1.0:1787134635.906476:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311958272 00000100:00100000:1.0:1787134635.906485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311958656 00000100:00100000:1.0:1787134635.906487:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311958656 00000100:00100000:1.0:1787134635.906499:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787134635.906504:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311958400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.906559:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311958400:12345-0@lo:400:kworker.0 Request processed in 55us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134635.906566:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787134635.906581:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787134635.906587:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311958272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.906608:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311958272:12345-0@lo:400:kworker.0 Request processed in 22us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134635.906614:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787134635.906622:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787134635.906626:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311958656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.906647:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311958656:12345-0@lo:400:kworker.0 Request processed in 21us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134635.906653:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787134635.906687:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311958656:0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.906714:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311958272:0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.906723:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311958400:0@lo:400:kworker.0 00000100:00080000:1.0:1787134635.906760:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787134635.906765:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134635.907579:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311958784:12345-0@lo:400:kworker.0 Request processed in 1372us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134635.907588:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787134635.907608:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311958528 00000100:00100000:3.0:1787134635.907613:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311958528 00000100:00100000:3.0:1787134635.907640:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787134635.907645:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311958528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134635.907674:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311958528:12345-0@lo:400:kworker.0 Request processed in 28us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134635.907680:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787134635.907780:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311958144 00000100:00100000:0.0:1787134635.907784:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311958144 00000100:00100000:0.0:1787134635.907817:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787134635.907824:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311958144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134635.907856:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311958144:12345-0@lo:400:kworker.0 Request processed in 33us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134635.907861:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:1.0:1787134635.908005:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6fc1aa00 x1873946311958528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134635.908029:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311958528:0@lo:400:kworker.0 00000100:00100000:1.0:1787134635.908039:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311958144:0@lo:400:kworker.0 00010000:00080000:1.0:1787134635.908070:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6fc18700 x1873946311958784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134635.908079:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311958784:0@lo:400:kworker.0 00000100:00100000:1.0:1787134636.416621:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311958912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134636.416699:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134636.416793:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311958912 00000100:00100000:1.0:1787134636.416804:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311958912 00000100:00100000:1.0:1787134636.416859:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787134636.416870:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311958912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134636.416914:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134636.416975:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311958912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134636.416982:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787134636.417042:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942760a80 x1873946311958912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134636.417062:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311958912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134636.480427:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787134637.290843:0:9234:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.11 00010000:00010000:1.0:1787134637.509763:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134638.530176:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134639.348646:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134639.348885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134639.349558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287808640 00000100:00100000:2.0:1787134639.349571:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287808640 00000100:00100000:2.0:1787134639.349704:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:2.0:1787134639.349720:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287808640:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134639.349830:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287808640:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 115us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134639.349839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00080000:0.0:1787134639.349937:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134639.353077:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287808512 00000100:00100000:1.0:1787134639.353100:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287808512 00000100:00100000:1.0:1787134639.353541:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 198 00000100:00100000:1.0:1787134639.353576:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2351:x1873946287808512:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134639.353755:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2351:x1873946287808512:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 182us (5125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134639.353765:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 198 00000100:00100000:2.0:1787134639.490455:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134639.490493:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311959040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134639.490616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134639.490848:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311959040 00000100:00100000:0.0:1787134639.490860:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311959040 00000100:00100000:0.0:1787134639.490964:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787134639.490979:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311959040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787134639.491062:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134639.491134:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311959040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134639.491143:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787134639.491236:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6c700 x1873946311959040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134639.491262:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311959040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787134639.491318:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787134639.555206:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787134640.494694:0:9333:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.11 00010000:00010000:1.0:1787134640.582464:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134641.028387:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311959296:0@lo:400:kworker.0 00000100:00100000:3.0:1787134641.028393:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311959424:0@lo:400:kworker.0 00000100:00100000:0.0:1787134641.028482:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311959552:0@lo:400:kworker.0 00000100:00100000:1.0:1787134641.028607:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311959168:0@lo:400:kworker.0 00000100:00100000:2.0:1787134641.030143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134641.030262:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311959808:0@lo:400:kworker.0 00000100:00100000:2.0:1787134641.030312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134641.031466:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134641.031636:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311959296 00000100:00100000:0.0:1787134641.031647:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311959296 00000100:00100000:0.0:1787134641.031711:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787134641.031722:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311959296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134641.031783:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311959296:12345-0@lo:400:kworker.0 Request processed in 63us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134641.031792:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787134641.031843:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311959296:0@lo:400:kworker.0 00000100:00100000:3.0:1787134641.031952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134641.031995:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311959808 00000100:00100000:3.0:1787134641.032000:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311959808 00000100:00100000:3.0:1787134641.032036:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311959552 00000100:00100000:3.0:1787134641.032039:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311959552 00000100:00100000:3.0:1787134641.032058:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787134641.032065:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311959808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134641.032067:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787134641.032074:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311959552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134641.032111:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311959552:12345-0@lo:400:kworker.0 Request processed in 38us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134641.032117:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787134641.032179:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311959424 00000100:00100000:0.0:1787134641.032184:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311959424 00000100:00100000:0.0:1787134641.032218:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787134641.032224:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311959424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134641.032263:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311959424:12345-0@lo:400:kworker.0 Request processed in 39us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134641.032269:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1787134641.032999:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6a300 x1873946311959552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134641.033013:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311959552:0@lo:400:kworker.0 00000100:00100000:3.0:1787134641.033258:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311959808:12345-0@lo:400:kworker.0 Request processed in 1192us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134641.033265:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787134641.033297:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787134641.033303:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787134641.033305:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134641.033441:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311959424:0@lo:400:kworker.0 00010000:00080000:0.0:1787134641.037268:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d69880 x1873946311959808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134641.037369:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311959808:0@lo:400:kworker.0 00000100:00100000:1.0:1787134641.039426:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134641.039485:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311959680:0@lo:400:kworker.0 00000100:00100000:1.0:1787134641.039521:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134641.039567:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311959168 00000100:00100000:1.0:1787134641.039575:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311959168 00000100:00100000:1.0:1787134641.039618:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787134641.039627:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311959168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134641.039680:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311959168:12345-0@lo:400:kworker.0 Request processed in 54us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134641.039688:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787134641.039743:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311959168:0@lo:400:kworker.0 00000100:00100000:0.0:1787134641.039833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311959680 00000100:00100000:0.0:1787134641.039837:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311959680 00000100:00100000:0.0:1787134641.039903:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787134641.039911:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311959680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134641.040316:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311959680:12345-0@lo:400:kworker.0 Request processed in 405us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134641.040324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787134641.040436:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311959680:0@lo:400:kworker.0 00000100:00080000:1.0:1787134641.040680:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134641.540415:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787134641.540439:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311959936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134641.540526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134641.540652:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311959936 00000100:00100000:1.0:1787134641.540660:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311959936 00000100:00100000:1.0:1787134641.540713:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787134641.540735:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311959936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134641.540772:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134641.540821:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311959936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134641.540829:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787134641.540867:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942760e00 x1873946311959936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134641.540898:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311959936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787134641.601885:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134642.624446:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787134643.271729:0:9431:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.11 00010000:00010000:1.0:1787134643.652672:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134644.480078:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134644.480150:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134644.480250:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287808896 00000100:00100000:1.0:1787134644.480257:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287808768 00000100:00100000:3.0:1787134644.480265:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287808896 00000100:00100000:1.0:1787134644.480274:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287808768 00000100:00100000:3.0:1787134644.480331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:1.0:1787134644.480331:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 200 00000100:00100000:3.0:1787134644.480344:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287808896:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134644.480344:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2349:x1873946287808768:12345-192.168.202.36@tcp:400:kworker.0 00000100:00080000:2.0:1787134644.480429:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134644.490929:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2349:x1873946287808768:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 10563us (10752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134644.490949:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 200 00000100:00100000:2.0:1787134644.495495:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287808896:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 15137us (15416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134644.495517:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:1.0:1787134644.609333:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311960064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787134644.609410:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134644.609524:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311960064 00000100:00100000:0.0:1787134644.609535:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311960064 00000100:00100000:0.0:1787134644.609608:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787134644.609618:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311960064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787134644.609655:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134644.609705:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311960064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134644.609713:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787134644.609760:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6e680 x1873946311960064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134644.609781:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311960064:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787134644.609852:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787134644.681998:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787134645.079098:0:9479:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 19 06:17:23 EDT 2026 00010000:00010000:1.0:1787134645.696499:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134646.150105:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311960192:0@lo:400:kworker.0 00000100:00100000:1.0:1787134646.150105:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311960320:0@lo:400:kworker.0 00000100:00100000:0.0:1787134646.150287:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311960576:0@lo:400:kworker.0 00000100:00100000:1.0:1787134646.150805:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134646.150884:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311960832:0@lo:400:kworker.0 00000100:00100000:1.0:1787134646.150929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134646.150958:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787134646.150964:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311960448:0@lo:400:kworker.0 00000100:00100000:1.0:1787134646.150990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134646.151036:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311960320 00000100:00100000:1.0:1787134646.151043:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311960320 00000100:00100000:1.0:1787134646.151081:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311960448 00000100:00100000:1.0:1787134646.151084:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311960448 00000100:00100000:1.0:1787134646.151106:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787134646.151115:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311960320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134646.151185:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311960320:12345-0@lo:400:kworker.0 Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134646.151192:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787134646.151207:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787134646.152202:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311960448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134646.152327:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311960448:12345-0@lo:400:kworker.0 Request processed in 1114us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134646.152336:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787134646.152365:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134646.152405:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311960448:0@lo:400:kworker.0 00000100:00100000:1.0:1787134646.152415:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311960320:0@lo:400:kworker.0 00000100:00100000:3.0:1787134646.153574:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311960832 00000100:00100000:3.0:1787134646.153583:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311960832 00000100:00100000:3.0:1787134646.153632:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787134646.153641:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311960832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134646.153704:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311960832:12345-0@lo:400:kworker.0 Request processed in 64us (2773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134646.153710:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787134646.153729:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787134646.153750:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942763480 x1873946311960832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134646.153763:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311960832:0@lo:400:kworker.0 00000100:00100000:2.0:1787134646.155004:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134646.155026:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311960192 00000100:00100000:1.0:1787134646.155034:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311960192 00000100:00100000:2.0:1787134646.155053:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311960704:0@lo:400:kworker.0 00000100:00100000:1.0:1787134646.155076:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787134646.155085:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311960192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134646.155122:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134646.155137:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311960192:12345-0@lo:400:kworker.0 Request processed in 53us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134646.155151:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311960704 00000100:00100000:1.0:1787134646.155151:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787134646.155174:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311960704 00000100:00100000:2.0:1787134646.155224:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787134646.155233:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311960704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134646.155382:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134646.155466:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311960576 00000100:00100000:0.0:1787134646.155471:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311960576 00000100:00100000:0.0:1787134646.155506:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787134646.155514:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311960576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134646.155552:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311960576:12345-0@lo:400:kworker.0 Request processed in 40us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134646.155558:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787134646.155624:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942762a00 x1873946311960576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134646.155637:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311960576:0@lo:400:kworker.0 00000100:00100000:2.0:1787134646.158625:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311960704:12345-0@lo:400:kworker.0 Request processed in 3382us (3493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134646.158641:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787134646.158693:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787134646.158701:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134646.158749:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311960704:0@lo:400:kworker.0 00000100:00100000:2.0:1787134646.158784:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311960192:0@lo:400:kworker.0 00000100:00100000:0.0:1787134646.658097:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311960960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134646.658202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134646.658286:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311960960 00000100:00100000:0.0:1787134646.658293:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311960960 00000100:00100000:0.0:1787134646.658337:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787134646.658345:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311960960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787134646.658381:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134646.658425:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311960960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134646.658433:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787134646.658473:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6e680 x1873946311960960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134646.658492:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311960960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787134646.721469:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134647.745306:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134648.768909:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134649.598202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134649.598278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134649.598427:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287809152 00000100:00100000:3.0:1787134649.598443:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287809152 00000100:00100000:3.0:1787134649.598542:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:3.0:1787134649.598554:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287809152:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134649.598672:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287809152:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 120us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134649.598690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00080000:2.0:1787134649.598964:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134649.599086:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287809024 00000100:00100000:1.0:1787134649.599092:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287809024 00000100:00100000:1.0:1787134649.599132:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 202 00000100:00100000:1.0:1787134649.599140:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2349:x1873946287809024:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134649.599227:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2349:x1873946287809024:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 88us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134649.599235:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 202 00000100:00100000:2.0:1787134649.728467:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134649.728497:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311961088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134649.728592:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134649.728858:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311961088 00000100:00100000:0.0:1787134649.728870:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311961088 00000100:00100000:0.0:1787134649.728950:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787134649.728961:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311961088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787134649.729025:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134649.729087:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311961088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134649.729095:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787134649.729139:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6e680 x1873946311961088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134649.729180:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311961088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787134649.729313:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787134649.792490:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134650.817482:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134651.266009:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311961344:0@lo:400:kworker.0 00000100:00100000:0.0:1787134651.266012:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311961472:0@lo:400:kworker.0 00000100:00100000:1.0:1787134651.266082:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311961216:0@lo:400:kworker.0 00000100:00100000:0.0:1787134651.274768:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134651.274883:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787134651.274900:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311961856:0@lo:400:kworker.0 00000100:00100000:0.0:1787134651.274951:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134651.275548:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311961472 00000100:00100000:3.0:1787134651.275565:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311961472 00000100:00100000:3.0:1787134651.275638:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787134651.275664:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311961472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134651.275768:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311961472:12345-0@lo:400:kworker.0 Request processed in 119us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134651.275777:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787134651.275816:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311961856 00000100:00100000:3.0:1787134651.275820:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311961856 00000100:00100000:3.0:1787134651.275845:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787134651.275851:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311961856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134651.275882:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311961856:12345-0@lo:400:kworker.0 Request processed in 31us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134651.275888:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787134651.275936:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6d880 x1873946311961856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134651.275953:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311961856:0@lo:400:kworker.0 00000100:00100000:3.0:1787134651.275968:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311961472:0@lo:400:kworker.0 00000100:00080000:3.0:1787134651.276034:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787134651.276040:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134651.276438:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311961600:0@lo:400:kworker.0 00000100:00100000:3.0:1787134651.276476:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134651.276526:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311961600 00000100:00100000:3.0:1787134651.276530:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311961600 00000100:00100000:3.0:1787134651.276556:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787134651.276563:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311961600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134651.276596:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311961600:12345-0@lo:400:kworker.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134651.276603:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787134651.276614:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787134651.276629:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6e300 x1873946311961600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134651.276640:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311961600:0@lo:400:kworker.0 00000100:00100000:2.0:1787134651.284523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134651.289492:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311961344 00000100:00100000:0.0:1787134651.289517:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311961344 00000100:00100000:0.0:1787134651.289620:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787134651.289633:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311961344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134651.289792:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311961344:12345-0@lo:400:kworker.0 Request processed in 161us (5282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134651.289800:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787134651.295213:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311961344:0@lo:400:kworker.0 00000100:00100000:2.0:1787134651.295335:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134651.295401:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311961728:0@lo:400:kworker.0 00000100:00100000:2.0:1787134651.295440:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134651.295484:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311961728 00000100:00100000:2.0:1787134651.295492:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311961728 00000100:00100000:2.0:1787134651.295560:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787134651.295571:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311961728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134651.295635:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311961728:12345-0@lo:400:kworker.0 Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134651.295662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787134651.295688:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134651.295710:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311961728:0@lo:400:kworker.0 00000100:00100000:1.0:1787134651.297066:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311961216 00000100:00100000:1.0:1787134651.297080:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311961216 00000100:00100000:1.0:1787134651.297140:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787134651.297150:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311961216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134651.297255:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311961216:12345-0@lo:400:kworker.0 Request processed in 106us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134651.297263:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787134651.297321:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311961216:0@lo:400:kworker.0 00000100:00100000:3.0:1787134651.777783:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311961984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787134651.777897:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134651.778224:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311961984 00000100:00100000:1.0:1787134651.778235:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311961984 00000100:00100000:1.0:1787134651.778291:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787134651.778301:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311961984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134651.778348:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134651.778401:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311961984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134651.778410:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787134651.779552:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6ea00 x1873946311961984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134651.779579:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311961984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134651.841302:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134652.865493:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134653.890823:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134654.707588:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134654.707660:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134654.707991:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287809280 00000100:00100000:3.0:1787134654.708001:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287809280 00000100:00100000:3.0:1787134654.708063:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 204 00000100:00100000:3.0:1787134654.708075:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2349:x1873946287809280:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134654.708203:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2349:x1873946287809280:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 131us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134654.708210:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 204 00000100:00100000:0.0:1787134654.710900:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287809408 00000100:00100000:0.0:1787134654.710924:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287809408 00000100:00100000:0.0:1787134654.711074:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:0.0:1787134654.711089:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287809408:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134654.711275:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287809408:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 190us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134654.711307:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00080000:2.0:1787134654.712996:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134654.848537:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134654.848561:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311962112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134654.848633:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134654.848712:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311962112 00000100:00100000:2.0:1787134654.848721:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311962112 00000100:00100000:2.0:1787134654.848786:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787134654.848796:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311962112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787134654.848836:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134654.850304:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311962112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1501us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134654.850317:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787134654.850346:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787134654.851398:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a94377f100 x1873946311962112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134654.851426:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311962112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787134654.918079:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134655.936450:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134656.387206:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311962368:0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.387316:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134656.387388:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311962880:0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.387416:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134656.387449:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134656.387455:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311962496:0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.387476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134656.387513:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311962368 00000100:00100000:0.0:1787134656.387523:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311962368 00000100:00100000:0.0:1787134656.387575:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311962496 00000100:00100000:0.0:1787134656.387577:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311962496 00000100:00100000:0.0:1787134656.387607:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787134656.387617:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311962368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.387681:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311962368:12345-0@lo:400:kworker.0 Request processed in 65us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134656.387689:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787134656.387710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787134656.387717:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311962496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.387766:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311962496:12345-0@lo:400:kworker.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134656.387773:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787134656.387793:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311962880 00000100:00100000:0.0:1787134656.387797:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311962880 00000100:00100000:0.0:1787134656.387827:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787134656.387834:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311962880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.387886:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311962880:12345-0@lo:400:kworker.0 Request processed in 53us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134656.387893:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787134656.387918:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134656.387923:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134656.387961:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311962496:0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.387972:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311962368:0@lo:400:kworker.0 00010000:00080000:0.0:1787134656.387983:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6df80 x1873946311962880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134656.387994:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311962880:0@lo:400:kworker.0 00000100:00100000:3.0:1787134656.388195:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311962624:0@lo:400:kworker.0 00000100:00100000:3.0:1787134656.388233:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134656.388278:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787134656.388285:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311962240:0@lo:400:kworker.0 00000100:00100000:3.0:1787134656.388316:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134656.388339:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311962752:0@lo:400:kworker.0 00000100:00100000:3.0:1787134656.388359:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134656.388725:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311962624 00000100:00100000:0.0:1787134656.388745:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311962624 00000100:00100000:0.0:1787134656.388787:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787134656.388795:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311962624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.388840:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311962624:12345-0@lo:400:kworker.0 Request processed in 46us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134656.388847:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787134656.388869:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311962240 00000100:00100000:0.0:1787134656.388872:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311962240 00000100:00100000:0.0:1787134656.388898:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787134656.388904:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311962240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.388934:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311962240:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134656.388940:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:0.0:1787134656.388973:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134656.389005:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311962240:0@lo:400:kworker.0 00010000:00080000:0.0:1787134656.389018:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6e680 x1873946311962624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134656.389029:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311962624:0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.389051:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311962752 00000100:00100000:0.0:1787134656.389055:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311962752 00000100:00100000:0.0:1787134656.389083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787134656.389089:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311962752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134656.389121:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311962752:12345-0@lo:400:kworker.0 Request processed in 33us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134656.389127:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787134656.389143:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134656.389181:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311962752:0@lo:400:kworker.0 00000100:00100000:2.0:1787134656.898510:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94377dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311963008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134656.898621:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134656.898746:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311963008 00000100:00100000:2.0:1787134656.898756:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311963008 00000100:00100000:2.0:1787134656.898826:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787134656.898837:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311963008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787134656.898892:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134656.898952:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311963008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134656.898975:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787134656.899039:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a94377dc00 x1873946311963008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134656.899080:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94377dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311963008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787134656.965149:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134657.985980:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134659.009184:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134659.832374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134659.832441:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134659.832491:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287809536 00000100:00100000:2.0:1787134659.832507:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287809536 00000100:00100000:2.0:1787134659.832580:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 206 00000100:00100000:2.0:1787134659.832595:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2349:x1873946287809536:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134659.832710:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2349:x1873946287809536:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 109us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134659.832719:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 206 00000100:00100000:0.0:1787134659.832943:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287809664 00000100:00100000:0.0:1787134659.832948:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287809664 00000100:00100000:0.0:1787134659.833011:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00100000:0.0:1787134659.833021:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287809664:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134659.833068:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287809664:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 49us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134659.833075:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00080000:2.0:1787134659.833764:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134659.974005:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787134659.974040:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311963136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787134659.974147:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134659.980781:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311963136 00000100:00100000:2.0:1787134659.980809:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311963136 00000100:00100000:2.0:1787134659.980943:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787134659.980957:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311963136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787134659.981024:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134659.981221:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311963136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 266us (7072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134659.981231:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787134659.981540:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d69c00 x1873946311963136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134659.981583:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311963136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787134659.982128:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787134660.041816:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134661.058334:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134661.520851:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311963264:0@lo:400:kworker.0 00000100:00100000:2.0:1787134661.520955:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134661.521025:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311963776:0@lo:400:kworker.0 00000100:00100000:2.0:1787134661.521059:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134661.521093:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134661.521099:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311963648:0@lo:400:kworker.0 00000100:00100000:2.0:1787134661.521129:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134661.521198:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311963392:0@lo:400:kworker.0 00000100:00100000:2.0:1787134661.521226:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134661.521245:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311963904:0@lo:400:kworker.0 00000100:00100000:2.0:1787134661.521268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134661.521286:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787134661.521292:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311963520:0@lo:400:kworker.0 00000100:00100000:2.0:1787134661.521314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134661.525904:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311963264 00000100:00100000:0.0:1787134661.526023:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311963264 00000100:00100000:0.0:1787134661.526116:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787134661.526132:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311963264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134661.526312:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311963264:12345-0@lo:400:kworker.0 Request processed in 184us (5356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134661.526320:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787134661.526365:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311963776 00000100:00100000:0.0:1787134661.526370:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311963776 00000100:00100000:0.0:1787134661.526410:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311963392 00000100:00100000:0.0:1787134661.526414:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311963392 00000100:00100000:0.0:1787134661.526428:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311963520 00000100:00100000:0.0:1787134661.526431:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311963520 00000100:00100000:0.0:1787134661.526448:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787134661.526455:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311963776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134661.526493:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311963776:12345-0@lo:400:kworker.0 Request processed in 39us (5433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134661.526500:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787134661.526512:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787134661.526518:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311963392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134661.526554:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311963392:12345-0@lo:400:kworker.0 Request processed in 36us (5327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134661.526562:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787134661.526573:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787134661.526780:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311963264:0@lo:400:kworker.0 00000100:00100000:2.0:1787134661.526800:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311963776:0@lo:400:kworker.0 00000100:00100000:2.0:1787134661.526847:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311963392:0@lo:400:kworker.0 00000100:00100000:0.0:1787134661.530742:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311963520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134661.531753:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311963520:12345-0@lo:400:kworker.0 Request processed in 5162us (10426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134661.531776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787134661.531861:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311963648 00000100:00100000:0.0:1787134661.531875:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311963648 00000100:00100000:2.0:1787134661.532541:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311963520:0@lo:400:kworker.0 00000100:00100000:0.0:1787134661.532800:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311963904 00000100:00100000:0.0:1787134661.532823:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311963904 00000100:00100000:0.0:1787134661.532861:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787134661.532872:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311963648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134661.535868:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311963648:12345-0@lo:400:kworker.0 Request processed in 2983us (14723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134661.535892:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787134661.535946:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787134661.535963:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311963904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134661.536044:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311963904:12345-0@lo:400:kworker.0 Request processed in 90us (14775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134661.536052:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787134661.536107:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134661.536115:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134661.536120:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787134661.540809:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa74249500 x1873946311963648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134661.540837:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311963648:0@lo:400:kworker.0 00010000:00080000:2.0:1787134661.540919:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7424aa00 x1873946311963904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134661.540943:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311963904:0@lo:400:kworker.0 00000100:00100000:3.0:1787134662.017973:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311964032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787134662.018086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134662.018222:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311964032 00000100:00100000:3.0:1787134662.018233:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311964032 00000100:00100000:3.0:1787134662.018306:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787134662.018318:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311964032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134662.018386:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134662.018449:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311964032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134662.018458:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787134662.018514:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6ad80 x1873946311964032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134662.018538:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311964032:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787134662.082917:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134663.106885:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134664.128737:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134664.955573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134664.955632:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134664.955762:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287809920 00000100:00100000:1.0:1787134664.955778:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287809920 00000100:00100000:1.0:1787134664.955888:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:1.0:1787134664.955901:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287809920:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134664.956006:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287809920:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 109us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134664.956015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:2.0:1787134664.956225:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287809792 00000100:00100000:2.0:1787134664.956231:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287809792 00000100:00100000:2.0:1787134664.956273:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 208 00000100:00100000:2.0:1787134664.956280:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2351:x1873946287809792:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134664.956309:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2351:x1873946287809792:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 30us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134664.956315:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 208 00000100:00080000:0.0:1787134664.956418:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134665.088825:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134665.088873:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311964160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134665.088989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134665.089212:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311964160 00000100:00100000:3.0:1787134665.089224:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311964160 00000100:00100000:3.0:1787134665.089307:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787134665.089320:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311964160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134665.089391:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134665.089450:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311964160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134665.089460:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787134665.089705:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787134665.089749:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6ad80 x1873946311964160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134665.089775:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311964160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787134665.153293:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134666.190931:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787134666.436886:0:10110:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 06:17:44 (1787134664) === 00000100:00100000:3.0:1787134666.625137:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311964416:0@lo:400:kworker.0 00000100:00100000:3.0:1787134666.625271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134666.625348:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311964928:0@lo:400:kworker.0 00000100:00100000:3.0:1787134666.625379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134666.625415:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134666.625421:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311964544:0@lo:400:kworker.0 00000100:00100000:3.0:1787134666.625443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134666.625483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311964416 00000100:00100000:3.0:1787134666.625493:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311964416 00000100:00100000:3.0:1787134666.625549:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311964544 00000100:00100000:3.0:1787134666.625553:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311964544 00000100:00100000:3.0:1787134666.625585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787134666.625732:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311964416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134666.625808:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311964416:12345-0@lo:400:kworker.0 Request processed in 79us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134666.625815:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787134666.625835:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787134666.625841:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311964544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134666.625868:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311964544:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134666.625874:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787134666.625941:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311964544:0@lo:400:kworker.0 00000100:00100000:3.0:1787134666.625953:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311964416:0@lo:400:kworker.0 00000100:00100000:2.0:1787134666.626173:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311964672:0@lo:400:kworker.0 00000100:00100000:2.0:1787134666.626214:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134666.626243:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787134666.626250:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311964288:0@lo:400:kworker.0 00000100:00100000:2.0:1787134666.626286:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134666.626312:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311964800:0@lo:400:kworker.0 00000100:00100000:2.0:1787134666.626334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134666.626365:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311964928 00000100:00100000:2.0:1787134666.626369:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311964928 00000100:00100000:2.0:1787134666.626407:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311964672 00000100:00100000:2.0:1787134666.626409:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311964672 00000100:00100000:2.0:1787134666.626429:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787134666.626435:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311964928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134666.626481:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311964928:12345-0@lo:400:kworker.0 Request processed in 46us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134666.626488:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787134666.626501:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787134666.626506:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311964672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134666.626535:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311964672:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134666.626541:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787134666.626559:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311964288 00000100:00100000:2.0:1787134666.626562:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311964288 00000100:00100000:2.0:1787134666.626585:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787134666.627133:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311964288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134666.627198:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311964288:12345-0@lo:400:kworker.0 Request processed in 72us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134666.627204:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787134666.627264:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311964288:0@lo:400:kworker.0 00010000:00080000:2.0:1787134666.627280:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6b800 x1873946311964672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134666.627292:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311964672:0@lo:400:kworker.0 00000100:00100000:2.0:1787134666.627319:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311964800 00000100:00100000:2.0:1787134666.627323:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311964800 00000100:00100000:2.0:1787134666.627356:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787134666.627363:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311964800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134666.627397:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311964800:12345-0@lo:400:kworker.0 Request processed in 35us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134666.627414:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787134666.627442:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311964800:0@lo:400:kworker.0 00010000:00080000:2.0:1787134666.627470:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d69c00 x1873946311964928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134666.627479:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311964928:0@lo:400:kworker.0 00000100:00080000:0.0:1787134666.627765:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134666.627774:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134667.086082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134667.086289:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287810048 00000100:00100000:1.0:1787134667.086328:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287810048 00000100:00100000:1.0:1787134667.086419:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 210 00000100:00100000:1.0:1787134667.086432:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:8138:x1873946287810048:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787134667.086457:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134667.086483:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59debe00/0x69932dacae905e79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070208 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134667.086529:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59debe00/0x69932dacae905e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070208 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134667.086544:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59debe00/0x69932dacae905e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070208 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134667.086556:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59debe00, rc 0) 00000100:00100000:1.0:1787134667.086660:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8138:x1873946287810048:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 230us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134667.086668:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 210 00000100:00100000:0.0:1787134667.100832:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.101074:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287810176 00000100:00100000:2.0:1787134667.101090:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287810176 00000100:00100000:2.0:1787134667.101205:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 211 00000100:00100000:2.0:1787134667.101219:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8138:x1873946287810176:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787134667.108555:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8138:x1873946287810176:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 7324us (7724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.108570:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 211 00000100:00100000:0.0:1787134667.119701:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.120676:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287810304 00000100:00100000:2.0:1787134667.120695:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287810304 00000100:00100000:2.0:1787134667.120795:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 212 00000100:00100000:2.0:1787134667.120808:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8138:x1873946287810304:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787134667.121694:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8138:x1873946287810304:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 878us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.121708:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 212 00000100:00100000:2.0:1787134667.139335:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787134667.139375:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311965056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134667.139478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134667.139845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134667.140007:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311965056 00000100:00100000:3.0:1787134667.140033:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311965056 00000100:00100000:3.0:1787134667.140104:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787134667.140116:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311965056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134667.140207:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134667.140285:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311965056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134667.140293:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787134667.140513:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d69180 x1873946311965056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134667.140546:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311965056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134667.141152:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287810432 00000100:00100000:2.0:1787134667.141223:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287810432 00000100:00100000:2.0:1787134667.141273:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 213 00000100:00100000:2.0:1787134667.141282:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8142:x1873946287810432:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787134667.141869:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8142:x1873946287810432:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 586us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.141878:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 213 00000100:00100000:0.0:1787134667.170363:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.170626:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287810560 00000100:00100000:2.0:1787134667.170651:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287810560 00000100:00100000:2.0:1787134667.170741:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 214 00000100:00100000:2.0:1787134667.170756:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8142:x1873946287810560:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787134667.171730:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8142:x1873946287810560:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 972us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.171742:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 214 00000100:00100000:0.0:1787134667.189611:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.189922:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287810688 00000100:00100000:2.0:1787134667.189938:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287810688 00000100:00100000:2.0:1787134667.190030:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 215 00000100:00100000:2.0:1787134667.190044:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:8138:x1873946287810688:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787134667.190068:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134667.190091:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa413fde00/0x69932dacae905e80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070232 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134667.190128:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa413fde00/0x69932dacae905e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070232 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134667.190142:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa413fde00/0x69932dacae905e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070232 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134667.190409:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa413fde00, rc 0) 00000100:00100000:2.0:1787134667.190505:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:8138:x1873946287810688:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 463us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.190512:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 215 00010000:00010000:1.0:1787134667.200739:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134667.202297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.203356:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287810816 00000100:00100000:2.0:1787134667.203374:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287810816 00000100:00100000:2.0:1787134667.203480:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 216 00000100:00100000:2.0:1787134667.203493:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:8138:x1873946287810816:12345-192.168.202.36@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787134667.203530:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787134667.203562:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787134667.203566:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787134667.203570:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787134667.203572:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787134667.212473:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:8138:x1873946287810816:12345-192.168.202.36@tcp:256:mount.lustre.0 Request processed in 8956us (10162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.212496:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 216 00000100:00100000:1.0:1787134667.219107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134667.219206:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287810944 00000100:00100000:0.0:1787134667.219221:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287810944 00000100:00100000:0.0:1787134667.219441:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 217 00000100:00100000:0.0:1787134667.219455:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:8138:x1873946287810944:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787134667.219480:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134667.219510:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070239 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134667.219566:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070239 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134667.219591:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070239 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134667.219605:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451c00, rc 0) 00000100:00100000:0.0:1787134667.219709:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:8138:x1873946287810944:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 257us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134667.219718:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 217 00000100:00100000:1.0:1787134667.222700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.223152:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287811072 00000100:00100000:2.0:1787134667.223189:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287811072 00000100:00100000:2.0:1787134667.223250:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 218 00000100:00100000:2.0:1787134667.223274:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:8138:x1873946287811072:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787134667.223714:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:8138:x1873946287811072:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 452us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.223724:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 218 00000100:00100000:1.0:1787134667.228944:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.231731:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287811200 00000100:00100000:2.0:1787134667.231761:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287811200 00000100:00100000:2.0:1787134667.231890:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 219 00000100:00100000:2.0:1787134667.231904:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:8138:x1873946287811200:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787134667.232267:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:8138:x1873946287811200:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 365us (3337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.232277:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 219 00000100:00100000:0.0:1787134667.238764:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.238940:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287811328 00000100:00100000:2.0:1787134667.238954:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287811328 00000100:00100000:2.0:1787134667.239033:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 220 00000100:00100000:2.0:1787134667.239045:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:8146:x1873946287811328:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787134667.240237:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:8146:x1873946287811328:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 1181us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.240252:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 220 00000100:00100000:1.0:1787134667.254116:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134667.254292:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287811456 00000100:00100000:0.0:1787134667.254334:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287811456 00000100:00100000:0.0:1787134667.254412:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 221 00000100:00100000:0.0:1787134667.254424:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:8146:x1873946287811456:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787134667.254789:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:8146:x1873946287811456:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 365us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134667.254800:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 221 00000100:00100000:0.0:1787134667.262975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.263106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287811584 00000100:00100000:2.0:1787134667.263122:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287811584 00000100:00100000:2.0:1787134667.263231:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:2.0:1787134667.263241:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1873946287811584:12345-192.168.202.36@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787134667.263296:0:5837:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from 602cf179-3fa4-4e4c-92db-c355fb291830@192.168.202.36@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:2.0:1787134667.263373:0:5837:0:(genops.c:1406:class_connect()) connect: client 602cf179-3fa4-4e4c-92db-c355fb291830, cookie 0x69932dacae905e8e 00000004:00100000:2.0:1787134667.263416:0:5837:0:(mdt_handler.c:7486:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1787134667.263980:0:5837:0:(import.c:65:import_set_state_nolock()) ffff98aa6faba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787134667.264234:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+6:2348:x1873946287811584:12345-192.168.202.36@tcp:38:mount.lustre.0 Request processed in 992us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.264244:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787134667.272724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134667.275683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134667.275741:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134667.275843:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287811712 00000100:00100000:3.0:1787134667.275858:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287811712 00000100:00100000:3.0:1787134667.275945:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287811968 00000100:00100000:3.0:1787134667.275949:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287811968 00000100:00100000:3.0:1787134667.275968:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287811840 00000100:00100000:3.0:1787134667.275971:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287811840 00000100:00100000:3.0:1787134667.275988:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:3.0:1787134667.276000:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287811712:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134667.276115:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287811712:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 118us (3542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134667.276124:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:3.0:1787134667.276146:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:3.0:1787134667.276153:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+7:8138:x1873946287811968:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787134667.276236:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1787134667.277278:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134667.285259:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+7:8138:x1873946287811968:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 9086us (9672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.285297:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:2.0:1787134667.285345:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:2.0:1787134667.285359:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+6:0:x1873946287811840:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787134667.285546:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787134667.285579:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+6:0:x1873946287811840:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 224us (9836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134667.285586:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:2.0:1787134667.294888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134667.296328:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287812096 00000100:00100000:0.0:1787134667.296349:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287812096 00000100:00100000:0.0:1787134667.296456:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787134667.296469:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+6:8138:x1873946287812096:12345-192.168.202.36@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787134667.296643:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+6:8138:x1873946287812096:12345-192.168.202.36@tcp:40:mount.lustre.0 Request processed in 167us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134667.296652:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787134667.300545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134667.300718:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287812224 00000100:00100000:2.0:1787134667.300733:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287812224 00000100:00100000:2.0:1787134667.300798:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:2.0:1787134667.300809:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1873946287812224:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787134667.300852:0:6681:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from 602cf179-3fa4-4e4c-92db-c355fb291830@192.168.202.36@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:2.0:1787134667.300901:0:6681:0:(genops.c:1406:class_connect()) connect: client 602cf179-3fa4-4e4c-92db-c355fb291830, cookie 0x69932dacae905e95 00002000:00100000:2.0:1787134667.300917:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 602cf179-3fa4-4e4c-92db-c355fb291830/ffff98aa6fabd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787134667.300949:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787134667.301555:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1787134667.301723:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134667.301772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134667.301845:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287812352 00000100:00100000:3.0:1787134667.301853:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287812352 00000100:00100000:3.0:1787134667.301910:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:3.0:1787134667.301917:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa55147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1873946287812352:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787134667.301941:0:6682:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from 602cf179-3fa4-4e4c-92db-c355fb291830@192.168.202.36@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:3.0:1787134667.301966:0:6682:0:(genops.c:1406:class_connect()) connect: client 602cf179-3fa4-4e4c-92db-c355fb291830, cookie 0x69932dacae905e9c 00002000:00100000:3.0:1787134667.301974:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 602cf179-3fa4-4e4c-92db-c355fb291830/ffff98aa6f89a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787134667.301983:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787134667.302185:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787134667.302212:0:6682:0:(import.c:65:import_set_state_nolock()) ffff98aa6f89a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787134667.302301:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa55147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:602cf179-3fa4-4e4c-92db-c355fb291830+6:2348:x1873946287812352:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 383us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134667.302391:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00080000:2.0:1787134667.302483:0:6681:0:(import.c:65:import_set_state_nolock()) ffff98aa6fabc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787134667.302513:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:602cf179-3fa4-4e4c-92db-c355fb291830+6:2348:x1873946287812224:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 1705us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134667.302708:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287812480 00000100:00100000:1.0:1787134667.302715:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287812480 00000100:00100000:1.0:1787134667.302760:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:1.0:1787134667.302769:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:602cf179-3fa4-4e4c-92db-c355fb291830+6:8138:x1873946287812480:12345-192.168.202.36@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787134667.303667:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000004:00200000:1.0:1787134667.306825:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787134667.307271:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:602cf179-3fa4-4e4c-92db-c355fb291830+6:8138:x1873946287812480:12345-192.168.202.36@tcp:33:mount.lustre.0 Request processed in 4494us (5489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134667.307286:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00010000:00010000:3.0:1787134668.226416:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787134668.235300:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 602cf179-3fa4-4e4c-92db-c355fb291830 00000001:00100000:2.0:1787134668.823960:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 602cf179-3fa4-4e4c-92db-c355fb291830 00000001:00100000:1.0:1787134669.233744:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 602cf179-3fa4-4e4c-92db-c355fb291830 00010000:00010000:1.0:1787134669.255328:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134670.210107:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311965184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134670.210270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134670.210444:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311965184 00000100:00100000:3.0:1787134670.210457:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311965184 00000100:00100000:3.0:1787134670.210574:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787134670.210587:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311965184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134670.210651:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134670.210715:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311965184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134670.210724:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787134670.210776:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6a680 x1873946311965184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134670.210798:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311965184:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787134670.211504:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787134670.272321:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134671.300673:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134671.744519:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311965696:0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.744629:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134671.744704:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787134671.744712:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311965312:0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.744760:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134671.744788:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311965824:0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.744816:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134671.744845:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311965440:0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.744873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134671.744893:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311965952:0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.744934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134671.744953:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134671.744960:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311965568:0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.744987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134671.745026:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311965696 00000100:00100000:0.0:1787134671.745036:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311965696 00000100:00100000:0.0:1787134671.745092:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311965952 00000100:00100000:0.0:1787134671.745096:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311965952 00000100:00100000:0.0:1787134671.745134:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787134671.745145:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311965696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.745253:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311965696:12345-0@lo:400:kworker.0 Request processed in 109us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134671.745261:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787134671.745281:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787134671.745288:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311965952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.745323:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311965952:12345-0@lo:400:kworker.0 Request processed in 36us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134671.745330:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787134671.745350:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311965312 00000100:00100000:0.0:1787134671.745354:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311965312 00000100:00100000:0.0:1787134671.745391:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787134671.745399:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311965312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.745430:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311965312:12345-0@lo:400:kworker.0 Request processed in 33us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134671.745437:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787134671.745466:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311965824 00000100:00100000:0.0:1787134671.745470:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311965824 00000100:00100000:0.0:1787134671.745490:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311965440 00000100:00100000:0.0:1787134671.745493:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311965440 00000100:00100000:0.0:1787134671.745504:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311965568 00000100:00100000:0.0:1787134671.745506:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311965568 00000100:00100000:0.0:1787134671.745522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787134671.745528:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311965824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.745559:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311965824:12345-0@lo:400:kworker.0 Request processed in 31us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134671.745565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787134671.745577:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787134671.745582:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311965440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.745620:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311965440:12345-0@lo:400:kworker.0 Request processed in 37us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134671.745626:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787134671.745637:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787134671.745644:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311965568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.745672:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311965568:12345-0@lo:400:kworker.0 Request processed in 28us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134671.745678:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787134671.745708:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787134671.745721:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134671.745792:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311965568:0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.745805:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311965440:0@lo:400:kworker.0 00010000:00080000:0.0:1787134671.745820:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d0000 x1873946311965952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134671.745833:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311965952:0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.745874:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311965312:0@lo:400:kworker.0 00000100:00100000:0.0:1787134671.745885:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311965824:0@lo:400:kworker.0 00010000:00080000:0.0:1787134671.745896:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d2a00 x1873946311965696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134671.745906:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311965696:0@lo:400:kworker.0 00000100:00100000:1.0:1787134672.256815:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787134672.256852:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311966080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134672.256960:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134672.257140:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311966080 00000100:00100000:3.0:1787134672.257151:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311966080 00000100:00100000:3.0:1787134672.257246:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787134672.257260:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311966080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134672.257311:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134672.257381:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311966080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134672.257390:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787134672.257560:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6a680 x1873946311966080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134672.257594:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311966080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787134672.322357:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134672.634516:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134672.634569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134672.634625:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134672.634656:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134672.634717:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134672.634768:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287812864 00000100:00100000:0.0:1787134672.634784:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287812864 00000100:00100000:0.0:1787134672.634872:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287812736 00000100:00100000:0.0:1787134672.634876:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287812736 00000100:00100000:0.0:1787134672.634900:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:0.0:1787134672.634912:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287812864:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134672.635024:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287812864:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 114us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134672.635048:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:0.0:1787134672.635068:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:0.0:1787134672.635074:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287812736:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134672.635110:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287812736:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 36us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134672.635116:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:0.0:1787134672.635140:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287813120 00000100:00100000:0.0:1787134672.635144:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287813120 00000100:00100000:0.0:1787134672.635225:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287812992 00000100:00100000:0.0:1787134672.635229:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287812992 00000100:00100000:0.0:1787134672.635253:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:0.0:1787134672.635260:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287813120:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134672.635291:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287813120:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134672.635298:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:0.0:1787134672.635311:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:0.0:1787134672.635317:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287812992:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134672.635341:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287812992:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134672.635348:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00080000:0.0:1787134672.635364:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134672.635369:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134672.635373:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134672.635742:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287812608 00000100:00100000:2.0:1787134672.635748:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287812608 00000100:00100000:2.0:1787134672.635813:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 223 00000100:00100000:2.0:1787134672.635822:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287812608:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134672.635867:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287812608:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 46us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134672.635873:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 223 00010000:00010000:0.0:1787134673.344480:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134674.368632:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787134675.060513:0:10307:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1787134675.344413:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134675.344453:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311966208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134675.344578:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134675.345567:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311966208 00000100:00100000:0.0:1787134675.345608:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311966208 00000100:00100000:0.0:1787134675.345719:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787134675.345735:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311966208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787134675.345809:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134675.345935:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311966208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134675.345944:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787134675.346015:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa4dafd500 x1873946311966208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134675.346044:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311966208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787134675.346435:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787134675.397397:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134676.416965:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134676.864727:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311966464:0@lo:400:kworker.0 00000100:00100000:3.0:1787134676.864839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134676.864906:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311966976:0@lo:400:kworker.0 00000100:00100000:3.0:1787134676.864940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134676.864976:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134676.864982:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311966592:0@lo:400:kworker.0 00000100:00100000:3.0:1787134676.865007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134676.865047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311966464 00000100:00100000:3.0:1787134676.865057:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311966464 00000100:00100000:3.0:1787134676.865119:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311966592 00000100:00100000:3.0:1787134676.865123:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311966592 00000100:00100000:3.0:1787134676.865154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787134676.865204:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311966464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134676.865265:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311966464:12345-0@lo:400:kworker.0 Request processed in 64us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134676.865274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787134676.865293:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787134676.865316:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311966592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134676.865344:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311966592:12345-0@lo:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134676.865351:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1787134676.865374:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134676.865427:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311966592:0@lo:400:kworker.0 00000100:00100000:3.0:1787134676.865439:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311966464:0@lo:400:kworker.0 00000100:00100000:0.0:1787134676.865708:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311966336:0@lo:400:kworker.0 00000100:00100000:0.0:1787134676.865754:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134676.865795:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311966848:0@lo:400:kworker.0 00000100:00100000:0.0:1787134676.865819:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134676.865842:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134676.865848:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311966720:0@lo:400:kworker.0 00000100:00100000:0.0:1787134676.865871:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134676.865905:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311966848 00000100:00100000:0.0:1787134676.865909:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311966848 00000100:00100000:0.0:1787134676.865947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787134676.865955:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311966848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134676.865992:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311966848:12345-0@lo:400:kworker.0 Request processed in 38us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134676.865999:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787134676.866024:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311966976 00000100:00100000:0.0:1787134676.866039:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311966976 00000100:00100000:0.0:1787134676.866070:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311966720 00000100:00100000:0.0:1787134676.866073:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311966720 00000100:00100000:0.0:1787134676.866093:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787134676.866099:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311966976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134676.866139:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311966976:12345-0@lo:400:kworker.0 Request processed in 40us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134676.866146:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787134676.866184:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787134676.866192:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311966720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134676.866221:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311966720:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134676.866227:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787134676.866255:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134676.866259:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787134676.866295:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6bb80 x1873946311966720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134676.866309:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311966720:0@lo:400:kworker.0 00000100:00100000:0.0:1787134676.866321:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311966848:0@lo:400:kworker.0 00010000:00080000:0.0:1787134676.866353:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d69880 x1873946311966976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134676.866363:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311966976:0@lo:400:kworker.0 00000100:00100000:3.0:1787134676.868599:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311966336 00000100:00100000:3.0:1787134676.868618:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311966336 00000100:00100000:3.0:1787134676.868692:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787134676.868704:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311966336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134676.868817:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311966336:12345-0@lo:400:kworker.0 Request processed in 116us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134676.868824:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787134676.870848:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311966336:0@lo:400:kworker.0 00000100:00100000:3.0:1787134677.377867:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311967104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787134677.378218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134677.378464:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311967104 00000100:00100000:3.0:1787134677.378473:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311967104 00000100:00100000:3.0:1787134677.378536:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787134677.378555:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311967104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134677.378597:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134677.378651:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311967104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134677.378659:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787134677.378710:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d69f80 x1873946311967104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134677.378753:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311967104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134677.440983:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134677.756477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134677.756517:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134677.756548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134677.756576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134677.757325:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287813376 00000100:00100000:0.0:1787134677.757343:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287813376 00000100:00100000:0.0:1787134677.757457:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287813504 00000100:00100000:0.0:1787134677.757482:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287813504 00000100:00100000:0.0:1787134677.757514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:0.0:1787134677.757526:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287813376:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134677.757655:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287813376:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 130us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134677.757663:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:0.0:1787134677.757684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:0.0:1787134677.757690:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287813504:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134677.757714:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287813504:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134677.757720:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:0.0:1787134677.757742:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287813632 00000100:00100000:0.0:1787134677.757745:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287813632 00000100:00100000:0.0:1787134677.757770:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287813760 00000100:00100000:0.0:1787134677.757773:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287813760 00000100:00100000:0.0:1787134677.757789:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:0.0:1787134677.757794:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287813632:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134677.757816:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287813632:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 22us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134677.757822:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:0.0:1787134677.757831:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:0.0:1787134677.757835:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287813760:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134677.757859:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287813760:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134677.757866:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00080000:3.0:1787134677.761811:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787134677.761830:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787134677.761836:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134677.773683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134677.773910:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287813248 00000100:00100000:3.0:1787134677.773936:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287813248 00000100:00100000:3.0:1787134677.774030:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 225 00000100:00100000:3.0:1787134677.774041:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287813248:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134677.774147:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287813248:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 107us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134677.774155:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 225 00010000:00010000:0.0:1787134678.464389:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134679.490383:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134680.455007:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311967232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787134680.455100:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134680.459932:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311967232 00000100:00100000:3.0:1787134680.459953:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311967232 00000100:00080000:2.0:1787134680.460080:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787134680.460133:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787134680.460148:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311967232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134680.460225:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134680.460360:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311967232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (5258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134680.460369:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787134680.460637:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942763b80 x1873946311967232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134680.460663:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311967232:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787134680.512709:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134681.542686:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134681.984805:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311967488:0@lo:400:kworker.0 00000100:00100000:0.0:1787134681.984883:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134681.984961:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311968000:0@lo:400:kworker.0 00000100:00100000:0.0:1787134681.984987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134681.985018:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134681.985023:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311967616:0@lo:400:kworker.0 00000100:00100000:0.0:1787134681.985045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134681.985075:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311968000 00000100:00100000:0.0:1787134681.985084:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311968000 00000100:00100000:0.0:1787134681.985144:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787134681.985153:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311968000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134681.985228:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311968000:12345-0@lo:400:kworker.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134681.985236:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787134681.985258:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311967488 00000100:00100000:0.0:1787134681.985262:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311967488 00000100:00100000:0.0:1787134681.985283:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311967616 00000100:00100000:0.0:1787134681.985285:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311967616 00000100:00100000:0.0:1787134681.985300:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787134681.985306:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311967488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134681.985336:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311967488:12345-0@lo:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134681.985343:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787134681.985354:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787134681.985360:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311967616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134681.985381:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311967616:12345-0@lo:400:kworker.0 Request processed in 22us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134681.985400:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1787134681.985416:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787134681.985421:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134681.986080:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311967616:0@lo:400:kworker.0 00000100:00100000:0.0:1787134681.986092:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311967488:0@lo:400:kworker.0 00010000:00080000:0.0:1787134681.986104:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7424a680 x1873946311968000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134681.986114:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311968000:0@lo:400:kworker.0 00000100:00100000:3.0:1787134681.986231:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311967744:0@lo:400:kworker.0 00000100:00100000:3.0:1787134681.986281:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134681.986313:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787134681.986319:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311967360:0@lo:400:kworker.0 00000100:00100000:3.0:1787134681.986345:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134681.986367:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311967872:0@lo:400:kworker.0 00000100:00100000:3.0:1787134681.986387:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134681.986477:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311967744 00000100:00100000:0.0:1787134681.986482:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311967744 00000100:00100000:1.0:1787134681.986599:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311967872 00000100:00100000:1.0:1787134681.986603:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311967872 00000100:00100000:1.0:1787134681.986648:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787134681.986656:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311967872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134681.986714:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311967872:12345-0@lo:400:kworker.0 Request processed in 58us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134681.986720:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1787134681.986736:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134681.986753:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311967872:0@lo:400:kworker.0 00000100:00100000:1.0:1787134681.986790:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311967360 00000100:00100000:1.0:1787134681.986793:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311967360 00000100:00100000:1.0:1787134681.986819:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787134681.986834:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311967360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134681.986869:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311967360:12345-0@lo:400:kworker.0 Request processed in 36us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134681.986875:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787134681.986920:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311967360:0@lo:400:kworker.0 00000100:00100000:0.0:1787134681.990619:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787134681.990650:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311967744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134681.990756:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311967744:12345-0@lo:400:kworker.0 Request processed in 122us (4473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134681.990764:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787134681.991085:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa74248700 x1873946311967744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134681.991102:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311967744:0@lo:400:kworker.0 00000100:00100000:3.0:1787134682.496669:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134682.496697:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311968128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787134682.496812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134682.496975:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311968128 00000100:00100000:2.0:1787134682.496985:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311968128 00000100:00100000:2.0:1787134682.497048:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787134682.497065:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311968128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787134682.497108:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134682.497154:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311968128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134682.497182:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787134682.497579:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6bb80 x1873946311968128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134682.497600:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311968128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787134682.560427:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134682.871797:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134682.872202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134682.872229:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134682.872261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134682.872289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134682.872318:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287814144 00000100:00100000:3.0:1787134682.872328:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287814144 00000100:00100000:3.0:1787134682.872387:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287814016 00000100:00100000:3.0:1787134682.872391:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287814016 00000100:00100000:3.0:1787134682.872412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:3.0:1787134682.872422:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287814144:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134682.872635:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287814144:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 212us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134682.872643:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:3.0:1787134682.872676:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:3.0:1787134682.872683:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287814016:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134682.874888:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287814016:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 2200us (2621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134682.874900:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:3.0:1787134682.874940:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287814400 00000100:00100000:3.0:1787134682.874948:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287814400 00000100:00100000:3.0:1787134682.874994:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287814272 00000100:00100000:3.0:1787134682.874998:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287814272 00000100:00100000:3.0:1787134682.875023:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:3.0:1787134682.875032:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287814400:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134682.875057:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287814400:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 27us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134682.875064:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:3.0:1787134682.875075:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:3.0:1787134682.875082:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287814272:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134682.875104:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287814272:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 23us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134682.875110:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00080000:3.0:1787134682.875125:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787134682.875129:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787134682.875131:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134682.877976:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287813888 00000100:00100000:0.0:1787134682.877993:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287813888 00000100:00100000:0.0:1787134682.878114:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 227 00000100:00100000:0.0:1787134682.878126:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287813888:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134682.878239:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287813888:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 115us (6453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134682.878247:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 227 00010000:00010000:1.0:1787134683.587706:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134684.610110:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134685.569202:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134685.569239:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311968256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134685.569329:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134685.569406:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311968256 00000100:00100000:2.0:1787134685.569415:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311968256 00000100:00100000:2.0:1787134685.569480:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787134685.569491:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311968256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787134685.569542:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787134685.569937:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134685.570067:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311968256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 577us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134685.570076:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787134685.570176:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7424b800 x1873946311968256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134685.570212:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311968256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787134685.634863:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134686.656854:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134687.111442:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311968640:0@lo:400:kworker.0 00000100:00100000:2.0:1787134687.111531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134687.111610:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787134687.111617:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311968512:0@lo:400:kworker.0 00000100:00100000:2.0:1787134687.111640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134687.111670:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311969024:0@lo:400:kworker.0 00000100:00100000:2.0:1787134687.111695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134687.111735:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311968640 00000100:00100000:2.0:1787134687.111744:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311968640 00000100:00100000:3.0:1787134687.112029:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311968384:0@lo:400:kworker.0 00000100:00100000:3.0:1787134687.112070:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134687.112094:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311968896:0@lo:400:kworker.0 00000100:00100000:3.0:1787134687.112116:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134687.112130:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787134687.112135:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311968768:0@lo:400:kworker.0 00000100:00100000:3.0:1787134687.112179:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134687.112218:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311969024 00000100:00100000:3.0:1787134687.112223:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311969024 00000100:00100000:3.0:1787134687.112263:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311968768 00000100:00100000:3.0:1787134687.112267:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311968768 00000100:00100000:3.0:1787134687.112294:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787134687.112305:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311969024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134687.112362:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311969024:12345-0@lo:400:kworker.0 Request processed in 59us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134687.112369:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787134687.112387:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787134687.112394:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311968768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134687.112427:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311968768:12345-0@lo:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134687.112433:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787134687.112484:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa74248700 x1873946311968768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134687.112498:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311968768:0@lo:400:kworker.0 00000100:00100000:2.0:1787134687.112728:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311968512 00000100:00100000:2.0:1787134687.112733:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311968512 00000100:00100000:2.0:1787134687.112750:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311968896 00000100:00100000:2.0:1787134687.112753:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311968896 00000100:00100000:2.0:1787134687.112769:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787134687.112776:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311968640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134687.112814:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311968640:12345-0@lo:400:kworker.0 Request processed in 38us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134687.112820:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787134687.112942:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311968384 00000100:00100000:1.0:1787134687.112947:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311968384 00000100:00100000:1.0:1787134687.112979:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787134687.112985:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311968384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134687.113023:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311968384:12345-0@lo:400:kworker.0 Request processed in 39us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134687.113029:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787134687.113062:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311968384:0@lo:400:kworker.0 00000100:00100000:2.0:1787134687.113125:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787134687.113132:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311968512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134687.113377:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311968512:12345-0@lo:400:kworker.0 Request processed in 244us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134687.113384:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787134687.113398:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787134687.113405:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311968896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134687.113437:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311968896:12345-0@lo:400:kworker.0 Request processed in 33us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134687.113442:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787134687.113478:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787134687.113483:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787134687.113486:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134687.113517:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311968512:0@lo:400:kworker.0 00010000:00080000:2.0:1787134687.113530:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa74249180 x1873946311969024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134687.113540:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311969024:0@lo:400:kworker.0 00000100:00100000:2.0:1787134687.113567:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311968640:0@lo:400:kworker.0 00000100:00100000:1.0:1787134687.113654:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311968896:0@lo:400:kworker.0 00000100:00100000:0.0:1787134687.617870:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134687.617897:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311969152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134687.617978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134687.618045:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311969152 00000100:00100000:0.0:1787134687.618053:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311969152 00000100:00100000:0.0:1787134687.618101:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787134687.618110:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311969152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787134687.618146:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134687.618430:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311969152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 319us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134687.618438:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787134687.618850:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa4dafdc00 x1873946311969152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134687.618874:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311969152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787134687.683961:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134688.003683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134688.003721:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134688.003744:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134688.003768:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134688.003861:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134688.003898:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287814528 00000100:00100000:0.0:1787134688.003910:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287814528 00000100:00100000:0.0:1787134688.003967:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 229 00000100:00100000:0.0:1787134688.003979:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287814528:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134688.004054:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287814528:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 77us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134688.004062:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 229 00000100:00100000:0.0:1787134688.004095:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287814784 00000100:00100000:0.0:1787134688.004099:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287814784 00000100:00100000:0.0:1787134688.004133:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287814656 00000100:00100000:0.0:1787134688.004136:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287814656 00000100:00100000:0.0:1787134688.004154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:0.0:1787134688.004181:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287814784:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134688.004228:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287814784:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 48us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134688.004234:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:0.0:1787134688.004246:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:0.0:1787134688.004252:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287814656:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134688.004273:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287814656:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 21us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134688.004279:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:0.0:1787134688.004300:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287814912 00000100:00100000:0.0:1787134688.004304:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287814912 00000100:00100000:0.0:1787134688.004326:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287815040 00000100:00100000:0.0:1787134688.004329:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287815040 00000100:00100000:0.0:1787134688.004351:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787134688.004357:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2348:x1873946287814912:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:0.0:1787134688.004378:0:6682:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905e95 00000100:00080000:0.0:1787134688.004387:0:6682:0:(import.c:65:import_set_state_nolock()) ffff98aa6fabc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787134688.004435:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787134688.004786:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:602cf179-3fa4-4e4c-92db-c355fb291830+2:2348:x1873946287814912:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 427us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134688.004793:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787134688.004807:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:0.0:1787134688.004813:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2348:x1873946287815040:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:0.0:1787134688.004825:0:6682:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905e9c 00000100:00080000:0.0:1787134688.004831:0:6682:0:(import.c:65:import_set_state_nolock()) ffff98aa6f89a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787134688.004853:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787134688.004982:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:602cf179-3fa4-4e4c-92db-c355fb291830+2:2348:x1873946287815040:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 170us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134688.004987:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00080000:0.0:1787134688.005080:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134688.005085:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134688.005087:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787134688.005107:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134688.005113:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134688.706660:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787134688.736392:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 602cf179-3fa4-4e4c-92db-c355fb291830 00000020:00000080:2.0:1787134688.736403:0:7632:0:(genops.c:906:class_export_put()) final put ffff98aa6f89a000/602cf179-3fa4-4e4c-92db-c355fb291830 00000020:00000080:3.0:1787134688.736812:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6f89a000/602cf179-3fa4-4e4c-92db-c355fb291830 for lustre-OST0001 00000020:00000080:3.0:1787134688.736864:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa6f89a800 for lustre-OST0001 00000001:00100000:3.0:1787134689.245203:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 602cf179-3fa4-4e4c-92db-c355fb291830 00000020:00000080:3.0:1787134689.245213:0:6707:0:(genops.c:906:class_export_put()) final put ffff98aa6fabd800/602cf179-3fa4-4e4c-92db-c355fb291830 00000020:00000080:1.0:1787134689.247629:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6fabd800/602cf179-3fa4-4e4c-92db-c355fb291830 for lustre-OST0000 00000020:00000080:0.0:1787134689.248344:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa6fabc800 for lustre-OST0000 00010000:00010000:0.0:1787134689.733607:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134690.689758:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4daf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311969280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134690.689847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134690.690074:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311969280 00000100:00100000:3.0:1787134690.690090:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311969280 00000100:00100000:3.0:1787134690.690188:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787134690.690201:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311969280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134690.690256:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134690.690319:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311969280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134690.690327:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787134690.690374:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa4daf9180 x1873946311969280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134690.690394:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4daf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311969280:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787134690.690748:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787134690.752745:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134691.780928:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134692.225747:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311969408:0@lo:400:kworker.0 00000100:00100000:1.0:1787134692.225858:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134692.225934:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311969920:0@lo:400:kworker.0 00000100:00100000:3.0:1787134692.225937:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311969792:0@lo:400:kworker.0 00000100:00100000:1.0:1787134692.225999:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134692.226051:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134692.226073:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311969536:0@lo:400:kworker.0 00000100:00100000:1.0:1787134692.226117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134692.226143:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311970048:0@lo:400:kworker.0 00000100:00100000:1.0:1787134692.226220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134692.226238:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787134692.226243:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311969664:0@lo:400:kworker.0 00000100:00100000:1.0:1787134692.226273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134692.226390:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311969408 00000100:00100000:3.0:1787134692.226421:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311969408 00000100:00100000:3.0:1787134692.226491:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787134692.226504:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311969408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134692.226584:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311969408:12345-0@lo:400:kworker.0 Request processed in 81us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134692.226593:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787134692.226607:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311969920 00000100:00100000:0.0:1787134692.226617:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311969920 00000100:00100000:3.0:1787134692.226670:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311969792 00000100:00100000:3.0:1787134692.226678:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311969792 00000100:00100000:0.0:1787134692.226685:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311969536 00000100:00100000:0.0:1787134692.226692:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311969536 00000100:00100000:0.0:1787134692.226720:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311969664 00000100:00100000:0.0:1787134692.226723:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311969664 00000100:00100000:3.0:1787134692.226734:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311970048 00000100:00100000:3.0:1787134692.226741:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311970048 00000100:00100000:0.0:1787134692.226752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787134692.226766:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311969920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134692.226784:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787134692.226796:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311969792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134692.226840:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311969920:12345-0@lo:400:kworker.0 Request processed in 76us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134692.226849:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787134692.226882:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787134692.226884:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311969792:12345-0@lo:400:kworker.0 Request processed in 78us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134692.226895:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311969536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134692.226896:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787134692.226930:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787134692.226945:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311970048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134692.226972:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311969536:12345-0@lo:400:kworker.0 Request processed in 78us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134692.226992:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787134692.227004:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311970048:12345-0@lo:400:kworker.0 Request processed in 62us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134692.227014:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787134692.227028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787134692.227039:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311969664:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787134692.227088:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942760000 x1873946311969792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134692.227102:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311969664:12345-0@lo:400:kworker.0 Request processed in 61us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134692.227119:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311969792:0@lo:400:kworker.0 00000100:00100000:0.0:1787134692.227119:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1787134692.227215:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134692.227222:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134692.227226:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134692.227262:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311969664:0@lo:400:kworker.0 00000100:00100000:0.0:1787134692.227278:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311969536:0@lo:400:kworker.0 00010000:00080000:0.0:1787134692.227378:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942761880 x1873946311970048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134692.227478:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311970048:0@lo:400:kworker.0 00000100:00100000:1.0:1787134692.228561:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311969408:0@lo:400:kworker.0 00000100:00100000:1.0:1787134692.228580:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311969920:0@lo:400:kworker.0 00000100:00100000:1.0:1787134692.736663:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311970176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134692.736842:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134692.737089:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311970176 00000100:00100000:0.0:1787134692.737110:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311970176 00000100:00100000:0.0:1787134692.737196:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787134692.737207:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311970176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787134692.737249:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134692.737312:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311970176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134692.737320:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787134692.738577:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa4dafdc00 x1873946311970176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134692.738603:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311970176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787134692.802899:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134693.114852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134693.114895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134693.114931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134693.115058:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287815168 00000100:00100000:0.0:1787134693.115070:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287815168 00000100:00100000:0.0:1787134693.115146:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 231 00000100:00100000:0.0:1787134693.115317:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287815168:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134693.115407:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287815168:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 81us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134693.115423:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 231 00000100:00100000:2.0:1787134693.115742:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287815424 00000100:00100000:2.0:1787134693.115747:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287815424 00000100:00100000:2.0:1787134693.115794:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287815296 00000100:00100000:2.0:1787134693.115798:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287815296 00000100:00100000:2.0:1787134693.115822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:2.0:1787134693.115828:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287815424:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134693.115871:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287815424:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 43us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134693.115878:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:2.0:1787134693.115893:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00100000:2.0:1787134693.115898:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287815296:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134693.115921:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287815296:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 23us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134693.115926:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00080000:0.0:1787134693.116547:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787134693.828767:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134694.855503:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134695.811546:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134695.811581:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311970304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134695.811657:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134695.811841:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311970304 00000100:00100000:3.0:1787134695.811853:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311970304 00000100:00100000:3.0:1787134695.811929:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787134695.811940:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311970304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134695.811977:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134695.812027:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311970304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134695.812034:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787134695.812075:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa4dafa680 x1873946311970304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134695.812100:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311970304:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787134695.812773:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787134695.877022:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134696.896799:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134697.346011:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134697.346141:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134697.346181:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4daf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311970816:0@lo:400:kworker.0 00000100:00100000:0.0:1787134697.346300:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134697.346388:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311970816 00000100:00100000:0.0:1787134697.346397:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311970816 00000100:00100000:0.0:1787134697.346462:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787134697.346473:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311970816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.346520:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311970432:0@lo:400:kworker.0 00000100:00100000:0.0:1787134697.346525:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311970816:12345-0@lo:400:kworker.0 Request processed in 54us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134697.346532:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787134697.346552:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787134697.346553:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787134697.346584:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4daf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311970688:0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.346640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134697.346670:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134697.346676:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311970560:0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.346697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787134697.346817:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa4daf8a80 x1873946311970816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134697.346833:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4daf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311970816:0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.346912:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311970432 00000100:00100000:1.0:1787134697.346916:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311970432 00000100:00100000:1.0:1787134697.351231:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311970688 00000100:00100000:1.0:1787134697.351406:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311970688 00000100:00100000:1.0:1787134697.351585:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311970560 00000100:00100000:1.0:1787134697.351590:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311970560 00000100:00100000:1.0:1787134697.351622:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787134697.351633:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311970688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.351756:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311970688:12345-0@lo:400:kworker.0 Request processed in 124us (5114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134697.351766:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787134697.351784:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787134697.351790:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311970560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.351819:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311970560:12345-0@lo:400:kworker.0 Request processed in 30us (5121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134697.351826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787134697.351851:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787134697.351860:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311970432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.351901:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311970432:12345-0@lo:400:kworker.0 Request processed in 43us (5347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134697.351907:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787134697.351971:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311970432:0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.352009:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311970560:0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.352039:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4daf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311970688:0@lo:400:kworker.0 00000100:00100000:3.0:1787134697.353019:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4daf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311971072:0@lo:400:kworker.0 00000100:00100000:3.0:1787134697.353069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134697.353125:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311971072 00000100:00100000:3.0:1787134697.353131:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311971072 00000100:00100000:0.0:1787134697.353323:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311970944:0@lo:400:kworker.0 00000100:00100000:0.0:1787134697.353370:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134697.353442:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311970944 00000100:00100000:0.0:1787134697.353447:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311970944 00000100:00080000:2.0:1787134697.357048:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787134697.357061:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134697.357868:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787134697.357914:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311971072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134697.358214:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311971072:12345-0@lo:400:kworker.0 Request processed in 318us (5142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134697.358400:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787134697.358532:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa4daf8e00 x1873946311971072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134697.358553:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4daf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311971072:0@lo:400:kworker.0 00000100:00100000:0.0:1787134697.360511:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787134697.360599:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311970944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134697.360703:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311970944:12345-0@lo:400:kworker.0 Request processed in 180us (7331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134697.360710:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787134697.360767:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311970944:0@lo:400:kworker.0 00000100:00100000:1.0:1787134697.856705:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311971200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134697.856790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134697.856986:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311971200 00000100:00100000:0.0:1787134697.856995:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311971200 00000100:00100000:0.0:1787134697.857061:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787134697.857072:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311971200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787134697.857112:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134697.857201:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311971200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134697.857209:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787134697.857328:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d3480 x1873946311971200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134697.857358:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311971200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787134697.921055:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134698.254024:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134698.254068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134698.254112:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134698.254204:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287815552 00000100:00100000:3.0:1787134698.254216:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287815552 00000100:00100000:3.0:1787134698.254288:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 233 00000100:00100000:3.0:1787134698.254306:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287815552:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134698.254392:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287815552:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 95us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134698.254400:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 233 00000100:00100000:0.0:1787134698.254545:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287815808 00000100:00100000:0.0:1787134698.254551:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287815808 00000100:00100000:0.0:1787134698.254594:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287815680 00000100:00100000:0.0:1787134698.254597:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287815680 00000100:00100000:0.0:1787134698.254620:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 103 00000100:00100000:0.0:1787134698.254627:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2352:x1873946287815808:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134698.254658:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2352:x1873946287815808:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134698.254664:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 103 00000100:00100000:0.0:1787134698.254675:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00100000:0.0:1787134698.254680:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287815680:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134698.254698:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287815680:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 18us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134698.254720:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00080000:3.0:1787134698.254961:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787134698.950961:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787134699.620016:0:11012:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787134699.968515:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134700.932939:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4daf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311971328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787134700.933019:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134700.933068:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311971328 00000100:00100000:2.0:1787134700.933077:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311971328 00000100:00080000:1.0:1787134700.933120:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134700.933141:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787134700.933150:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311971328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787134700.933218:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134700.933278:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311971328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134700.933286:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787134700.936883:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa4daf8e00 x1873946311971328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134700.936909:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4daf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311971328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787134700.993393:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134702.016359:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134702.464824:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311971712:0@lo:400:kworker.0 00000100:00100000:1.0:1787134702.464920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134702.464986:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787134702.464993:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311971584:0@lo:400:kworker.0 00000100:00100000:1.0:1787134702.465017:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134702.465032:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311972096:0@lo:400:kworker.0 00000100:00100000:1.0:1787134702.465056:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134702.465234:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311971456:0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.465282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134702.465320:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311971968:0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.465352:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134702.465375:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134702.465380:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311971840:0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.465400:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134702.465428:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311971712 00000100:00100000:0.0:1787134702.465437:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311971712 00000100:00100000:0.0:1787134702.465487:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311971584 00000100:00100000:0.0:1787134702.465490:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311971584 00000100:00100000:0.0:1787134702.465697:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311971968 00000100:00100000:0.0:1787134702.465701:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311971968 00000100:00100000:0.0:1787134702.465722:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787134702.465731:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311971712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.465787:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946311971712:12345-0@lo:400:kworker.0 Request processed in 56us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134702.465794:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787134702.465810:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787134702.465816:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311971584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.465843:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946311971584:12345-0@lo:400:kworker.0 Request processed in 28us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134702.465861:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787134702.465872:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787134702.465877:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311971968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.465910:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311971968:12345-0@lo:400:kworker.0 Request processed in 32us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134702.465915:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787134702.465937:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311972096 00000100:00100000:0.0:1787134702.465941:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311972096 00000100:00100000:0.0:1787134702.465966:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311971840 00000100:00100000:0.0:1787134702.465968:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311971840 00000100:00100000:0.0:1787134702.465986:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787134702.465992:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311972096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.466022:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311972096:12345-0@lo:400:kworker.0 Request processed in 30us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134702.466027:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787134702.466038:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787134702.466043:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311971840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.466065:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311971840:12345-0@lo:400:kworker.0 Request processed in 23us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134702.466071:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787134702.466093:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134702.466097:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134702.466099:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787134702.466133:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6fc19880 x1873946311971840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134702.466147:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311971840:0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.466197:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311971968:0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.466230:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946311971584:0@lo:400:kworker.0 00010000:00080000:0.0:1787134702.466240:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa6fc1b100 x1873946311972096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134702.466250:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311972096:0@lo:400:kworker.0 00000100:00100000:0.0:1787134702.466260:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946311971712:0@lo:400:kworker.0 00000100:00100000:1.0:1787134702.470771:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311971456 00000100:00100000:1.0:1787134702.470787:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311971456 00000100:00100000:1.0:1787134702.470851:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787134702.470862:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311971456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134702.470960:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311971456:12345-0@lo:400:kworker.0 Request processed in 100us (5677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134702.470968:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787134702.471204:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311971456:0@lo:400:kworker.0 00000100:00100000:3.0:1787134702.978863:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134702.978901:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311972224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787134702.978974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134702.979237:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311972224 00000100:00100000:0.0:1787134702.979247:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311972224 00000100:00100000:0.0:1787134702.979322:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787134702.979343:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311972224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787134702.979637:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134702.981496:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311972224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2155us (2513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134702.981513:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787134702.989433:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d3b80 x1873946311972224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134702.989467:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311972224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787134703.044813:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134703.348623:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134703.348681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134703.348713:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134703.348741:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287815936 00000100:00100000:0.0:1787134703.348750:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287815936 00000100:00100000:0.0:1787134703.348803:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 235 00000100:00100000:0.0:1787134703.348812:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287815936:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134703.348882:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287815936:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134703.348898:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 235 00000100:00100000:0.0:1787134703.348943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287816064 00000100:00100000:0.0:1787134703.348947:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287816064 00000100:00100000:0.0:1787134703.348982:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287816192 00000100:00100000:0.0:1787134703.348985:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287816192 00000100:00100000:0.0:1787134703.349001:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00100000:0.0:1787134703.349008:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287816064:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134703.349039:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287816064:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134703.349046:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00100000:0.0:1787134703.349056:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 109 00000100:00100000:0.0:1787134703.349063:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+5:2352:x1873946287816192:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134703.349086:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+5:2352:x1873946287816192:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134703.349092:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 109 00000100:00080000:0.0:1787134703.349243:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787134703.492802:0:11159:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffff285800 20000000:00000080:2.0:1787134703.492823:0:11159:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98aa7bd40000 uarg=0000000000000000 20000000:01000000:2.0:1787134703.492866:0:11159:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787134703.492872:0:11159:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787134703.492877:0:11159:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787134703.497096:0:11160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787134703.498363:0:11159:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787134703.518874:0:11159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787134703.524422:0:11159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524449:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070201 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524458:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905e4f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524465:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905e5d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524472:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905e6b expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524493:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070239 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524501:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524553:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070239 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524570:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070239 expref: 12 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.524585:0:11159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74249180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311972352:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134703.524717:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905e6b expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524726:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905e6b expref: 18 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.524735:0:11159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311972480:0@lo:104: 00000100:00100000:2.0:1787134703.524780:0:11159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787134703.524812:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905e5d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.524821:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905e5d expref: 18 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.524829:0:11159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74248a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311972608:0@lo:104: 00000100:00100000:2.0:1787134703.524860:0:11159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134703.524895:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311972480 00000100:00100000:2.0:1787134703.524903:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311972480 00000100:00100000:2.0:1787134703.524950:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311972608 00000100:00100000:2.0:1787134703.524954:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311972608 00000100:00100000:2.0:1787134703.524970:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787134703.524978:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:11159:x1873946311972480:12345-0@lo:104: 00010000:00010000:2.0:1787134703.524992:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525036:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787134703.525043:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:11159:x1873946311972480:12345-0@lo:104: Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134703.525049:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787134703.525066:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787134703.525071:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:11159:x1873946311972608:12345-0@lo:104: 00010000:00010000:2.0:1787134703.525078:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525108:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787134703.525113:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:11159:x1873946311972608:12345-0@lo:104: Request processed in 42us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134703.525119:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787134703.525136:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787134703.525142:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525150:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ac00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1787134703.525153:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525194:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134703.525201:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134703.525212:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787134703.525242:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525249:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787134703.525268:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525275:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7ac00/0x69932dacae905e6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905e72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525287:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134703.525290:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525306:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fca00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1787134703.525309:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525316:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134703.525322:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134703.525333:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787134703.525348:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525354:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787134703.525360:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525366:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa413fca00/0x69932dacae905e5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905e64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525376:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134703.525378:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134703.525379:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134703.525400:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311972736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134703.525433:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134703.525459:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134703.525465:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311972864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134703.525486:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134703.525513:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311972736 00000100:00100000:2.0:1787134703.525517:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311972736 00010000:00010000:2.0:1787134703.525533:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905e6b expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.525551:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311972864 00000100:00100000:2.0:1787134703.525553:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311972864 00010000:00010000:2.0:1787134703.525564:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905e5d expref: 20 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.525595:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787134703.525602:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa47faf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+20:3309:x1873946311972736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134703.525613:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134703.525619:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905e6b expref: 20 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525629:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905e6b expref: 20 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525647:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134703.525674:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa47faf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+20:3309:x1873946311972736:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134703.525681:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787134703.525725:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787134703.525732:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311972864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134703.525740:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134703.525744:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905e5d expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525753:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905e5d expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525761:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134703.525782:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311972864:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134703.525787:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787134703.525825:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311972864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134703.525842:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311972736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134703.525880:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905e4f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.525890:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905e4f expref: 18 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.525898:0:11159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311972992:0@lo:104: 00000100:00100000:2.0:1787134703.525920:0:11159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134703.525939:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311972992 00000100:00100000:2.0:1787134703.525943:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311972992 00000100:00100000:2.0:1787134703.525959:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787134703.525964:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:11159:x1873946311972992:12345-0@lo:104: 00010000:00010000:2.0:1787134703.525972:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.526002:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787134703.526008:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:11159:x1873946311972992:12345-0@lo:104: Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134703.526014:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787134703.526027:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134703.526031:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.526037:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea600 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1787134703.526040:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.526057:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134703.526064:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134703.526069:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787134703.526088:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.526095:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787134703.526110:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.526116:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa59dea600/0x69932dacae905e4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905e56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.526129:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134703.526130:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134703.526132:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134703.526147:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311973120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134703.526198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134703.526229:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311973120 00000100:00100000:2.0:1787134703.526232:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311973120 00010000:00010000:2.0:1787134703.526247:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905e4f expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.526263:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787134703.526269:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311973120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134703.526284:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134703.526289:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905e4f expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.526309:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905e4f expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.526320:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134703.526348:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311973120:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134703.526353:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787134703.526377:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311973120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134703.526404:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070201 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.526413:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070201 expref: 12 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.526423:0:11159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311973248:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134703.526461:0:11159:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abbf00 going to sleep for 11 seconds 00010000:00010000:2.0:1787134703.526474:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea800/0x69932dacae905e72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905e6b expref: 18 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.526484:0:11159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311972480:0@lo:104: 00010000:00010000:2.0:1787134703.526492:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea000/0x69932dacae905e64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905e5d expref: 17 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.526499:0:11159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74248a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311972608:0@lo:104: 00010000:00010000:2.0:1787134703.526517:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa81451200/0x69932dacae905e56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905e4f expref: 16 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.526525:0:11159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311972992:0@lo:104: 00010000:00010000:0.0:1787134703.526826:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134703.531308:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134703.531411:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287816320 00000100:00100000:1.0:1787134703.531421:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287816320 00010000:00010000:1.0:1787134703.531462:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070239 expref: 13 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134703.531499:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:1.0:1787134703.531507:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287816320:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134703.531523:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134703.531529:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070239 expref: 13 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134703.531553:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070239 expref: 13 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134703.531576:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134703.531636:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287816320:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 128us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134703.531644:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 28 00010000:00010000:2.0:1787134703.534150:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa81451c00/0x69932dacae905e87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070239 expref: 12 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.534191:0:11159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74249180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311972352:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134703.534206:0:11159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1873946311973248:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134703.534250:0:11159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134703.550751:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134703.550915:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287816448 00000100:00100000:2.0:1787134703.550926:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287816448 00010000:00010000:2.0:1787134703.550978:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070201 expref: 12 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134703.551017:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:2.0:1787134703.551026:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:2352:x1873946287816448:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134703.551044:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134703.551050:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070201 expref: 12 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551064:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070201 expref: 12 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551082:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae905e48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070201 expref: 12 pid: 5828 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551117:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551125:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551141:0:7620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551148:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551155:0:7620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551215:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551221:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fc600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134703.551226:0:7620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551234:0:7620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551249:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134703.551259:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134703.551322:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:2352:x1873946287816448:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 296us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134703.551336:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 29 00010000:00010000:0.0:1787134703.551638:0:11159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134703.551649:0:11159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134703.551655:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa413fc600/0x69932dacae905ea3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134704.064454:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134705.088409:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134705.281774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134705.281860:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287816576 00000100:00100000:2.0:1787134705.281871:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287816576 00000100:00100000:2.0:1787134705.281989:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 236 00000100:00100000:2.0:1787134705.281998:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:5593:x1873946287816576:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787134705.282014:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134705.282030:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070263 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134705.282134:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070263 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134705.282145:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070263 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134705.282153:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa413fca00, rc 0) 00000100:00100000:2.0:1787134705.282232:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287816576:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 235us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134705.282241:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 236 00000100:00100000:2.0:1787134705.300435:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134705.300941:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287816704 00000100:00100000:1.0:1787134705.300955:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287816704 00000100:00100000:1.0:1787134705.301022:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 237 00000100:00100000:1.0:1787134705.301034:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287816704:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134705.303275:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287816704:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 2234us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134705.303300:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 237 00000100:00100000:1.0:1787134705.322473:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134705.324521:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287816832 00000100:00100000:2.0:1787134705.324536:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287816832 00000100:00100000:2.0:1787134705.324668:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 238 00000100:00100000:2.0:1787134705.324678:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287816832:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787134705.324922:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287816832:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 244us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134705.324936:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 238 00000100:00100000:1.0:1787134705.330944:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134705.331027:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287816960 00000100:00100000:0.0:1787134705.331039:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287816960 00000100:00100000:0.0:1787134705.331104:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 239 00000100:00100000:0.0:1787134705.331115:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287816960:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134705.331137:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134705.331176:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac907026a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134705.331206:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907026a expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134705.331217:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907026a expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134705.331227:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451000, rc 0) 00000100:00100000:0.0:1787134705.331298:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287816960:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 184us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134705.331305:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 239 00000100:00100000:0.0:1787134705.336964:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134705.339654:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287817088 00000100:00100000:2.0:1787134705.339672:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287817088 00000100:00100000:2.0:1787134705.340380:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 240 00000100:00100000:2.0:1787134705.340396:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287817088:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787134705.340802:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287817088:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 409us (3846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134705.340811:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 240 00000100:00100000:2.0:1787134705.343144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134705.343337:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287817216 00000100:00100000:1.0:1787134705.343349:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287817216 00000100:00100000:1.0:1787134705.343406:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 241 00000100:00100000:1.0:1787134705.343416:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287817216:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134705.343618:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287817216:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 203us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134705.343626:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 241 10000000:01000000:2.0:1787134705.472263:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787134705.472272:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa52a7d800 from 7 10000000:01000000:2.0:1787134705.472288:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787134705.472344:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134705.472358:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134705.472371:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134705.472483:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787134705.472571:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134705.474394:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787134705.475263:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311973376 00000100:00100000:1.0:1787134705.475274:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311973376 00000100:00100000:1.0:1787134705.475388:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787134705.475409:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311973376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134705.475427:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134705.475446:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905eb8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.475474:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905eb8 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.475498:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905eb8 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.475507:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deae00, rc 0) 00000100:00100000:1.0:1787134705.475591:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311973376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134705.475598:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787134705.475686:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134705.475705:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134705.475714:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134705.475799:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134705.475835:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134705.483049:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5023d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134705.489237:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311973504 00000100:00100000:2.0:1787134705.489257:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311973504 00000100:00100000:2.0:1787134705.489346:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787134705.489356:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311973504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787134705.489771:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311973504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 415us (13933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134705.489781:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787134705.489844:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787134705.489903:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787134705.489956:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134705.490128:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787134705.490153:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311973632 00000100:00100000:2.0:1787134705.490184:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311973632 00000100:00100000:2.0:1787134705.490205:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787134705.490211:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311973632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787134705.490366:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311973632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134705.490372:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787134705.490599:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787134705.491606:0:11222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787134705.491679:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787134705.491702:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787134705.491730:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134705.491743:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134705.491755:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787134705.491759:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa438c0800 from 7 10000000:01000000:2.0:1787134705.491772:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787134705.491807:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134705.491816:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134705.491825:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134705.491846:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787134705.491898:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134705.491932:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa44e9a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134705.491952:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311973760 00000100:00100000:2.0:1787134705.491958:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311973760 00000100:00100000:1.0:1787134705.492090:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787134705.492102:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311973760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134705.492115:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134705.492130:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905ec6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.492153:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905ec6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.492177:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905ec6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.492185:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea400, rc 0) 00000100:00100000:1.0:1787134705.492227:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311973760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134705.492233:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787134705.492275:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134705.492302:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.492322:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134705.492375:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134705.492415:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134705.492430:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1787134705.492442:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311973888 00000100:00100000:1.0:1787134705.492446:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311973888 00000100:00100000:1.0:1787134705.492464:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787134705.492470:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311973888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134705.492707:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311973888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134705.492714:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787134705.492742:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311973888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134705.492769:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311974016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134705.492809:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134705.492822:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa479ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1787134705.492833:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311974016 00000100:00100000:1.0:1787134705.492836:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311974016 00000100:00100000:1.0:1787134705.492853:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787134705.492859:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311974016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134705.493135:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311974016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134705.493142:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787134705.493228:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311974016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787134705.497261:0:11223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787134705.498538:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787134705.498565:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787134705.498577:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134705.498591:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134705.498602:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787134705.498604:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa4da38000 from 7 10000000:01000000:3.0:1787134705.498607:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787134705.498660:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134705.498669:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134705.498682:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134705.498727:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311974144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787134705.498808:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134705.499245:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5023da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787134705.501107:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311974144 00000100:00100000:1.0:1787134705.501119:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311974144 00000100:00100000:1.0:1787134705.501205:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787134705.501216:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311974144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134705.501233:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134705.501251:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae905ed4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.501288:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae905ed4 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.501301:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905ed4 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134705.501313:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb800, rc 0) 00000100:00100000:0.0:1787134705.502574:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311974144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134705.502603:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134705.502615:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134705.503077:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311974144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (2592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134705.503087:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787134705.503610:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311974272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134705.503685:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134705.503733:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa43375900 going to sleep for 11 seconds 00000100:00100000:1.0:1787134705.504078:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311974272 00000100:00100000:1.0:1787134705.504086:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311974272 00000100:00100000:1.0:1787134705.504132:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787134705.504140:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311974272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134705.505615:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311974272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1468us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134705.505628:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787134705.505737:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311974272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134705.505787:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311974400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134705.505836:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134705.505876:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa43375900 going to sleep for 11 seconds 00000100:00100000:1.0:1787134705.505923:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311974400 00000100:00100000:1.0:1787134705.505936:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311974400 00000100:00100000:1.0:1787134705.506261:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787134705.506271:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311974400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134705.506459:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311974400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134705.506466:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787134705.507902:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311974400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787134705.508648:0:11224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787134705.508711:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787134705.508732:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787134705.508743:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134705.508756:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134706.053133:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311974528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787134706.053230:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134706.053317:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311974528 00000100:00100000:1.0:1787134706.053325:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311974528 00000100:00100000:1.0:1787134706.053390:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787134706.058359:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311974528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134706.058412:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134706.058499:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311974528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (5268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134706.058508:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787134706.058543:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787134706.058583:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81bc3480 x1873946311974528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134706.058605:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311974528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787134706.115764:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134707.145350:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134707.584353:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311974912:0@lo:400:kworker.0 00000100:00100000:1.0:1787134707.584440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134707.584511:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787134707.584519:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311975040:0@lo:400:kworker.0 00000100:00100000:1.0:1787134707.584550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134707.584671:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311974656:0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.584712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134707.584744:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311975168:0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.584776:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134707.584798:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787134707.584805:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311974784:0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.584840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134707.584862:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311975296:0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.584887:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134707.584921:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311974912 00000100:00100000:3.0:1787134707.584928:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311974912 00000100:00100000:3.0:1787134707.584978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311975168 00000100:00100000:3.0:1787134707.584982:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311975168 00000100:00100000:3.0:1787134707.584999:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311974784 00000100:00100000:3.0:1787134707.585002:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311974784 00000100:00100000:3.0:1787134707.585023:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787134707.585033:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311974912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.585098:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311974912:12345-0@lo:400:kworker.0 Request processed in 66us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134707.585107:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787134707.585131:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787134707.585138:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311975168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.585197:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311975168:12345-0@lo:400:kworker.0 Request processed in 59us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134707.585204:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787134707.585221:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787134707.585229:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311974784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134707.585443:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311974656 00000100:00100000:1.0:1787134707.585447:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311974656 00000100:00100000:1.0:1787134707.585476:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787134707.585485:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311974656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134707.585595:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311974656:12345-0@lo:400:kworker.0 Request processed in 111us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134707.585602:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787134707.585858:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311974784:12345-0@lo:400:kworker.0 Request processed in 629us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134707.585865:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787134707.585897:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311975040 00000100:00100000:3.0:1787134707.585902:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311975040 00000100:00100000:3.0:1787134707.585932:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311975296 00000100:00100000:3.0:1787134707.585942:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311975296 00000100:00100000:0.0:1787134707.585947:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787134707.585960:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311975040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.585971:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787134707.585981:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311975296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134707.586014:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311975040:12345-0@lo:400:kworker.0 Request processed in 58us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134707.586022:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787134707.586026:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311975296:12345-0@lo:400:kworker.0 Request processed in 45us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134707.586035:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787134707.586057:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787134707.586062:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134707.586104:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311974784:0@lo:400:kworker.0 00010000:00080000:3.0:1787134707.586120:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81bc1180 x1873946311975296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134707.586131:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311975296:0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.586140:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311974656:0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.586149:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311975168:0@lo:400:kworker.0 00010000:00080000:3.0:1787134707.586889:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81bc0380 x1873946311975040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134707.586902:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311975040:0@lo:400:kworker.0 00000100:00100000:3.0:1787134707.586915:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311974912:0@lo:400:kworker.0 00000001:02000400:2.0:1787134707.607659:0:11357:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787134708.096613:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311975424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787134708.096711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134708.096842:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311975424 00000100:00100000:1.0:1787134708.096850:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311975424 00000100:00100000:1.0:1787134708.096908:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787134708.096918:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311975424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134708.096957:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134708.097225:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311975424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 308us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134708.097233:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787134708.097327:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d0700 x1873946311975424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134708.097347:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311975424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787134708.160574:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134708.472265:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134708.472315:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134708.472348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134708.472434:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287817600 00000100:00100000:0.0:1787134708.472447:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287817600 00000100:00100000:0.0:1787134708.472518:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287817472 00000100:00100000:0.0:1787134708.472521:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287817472 00000100:00100000:0.0:1787134708.472534:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 113 00000100:00100000:0.0:1787134708.472542:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287817600:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134708.472619:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287817600:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134708.472627:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 113 00000100:00100000:0.0:1787134708.472644:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00100000:0.0:1787134708.472655:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287817472:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134708.472671:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287817472:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 18us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134708.472675:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00080000:1.0:1787134708.472744:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134708.472843:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287817344 00000100:00100000:2.0:1787134708.472846:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287817344 00000100:00100000:2.0:1787134708.472872:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 252 00000100:00100000:2.0:1787134708.472877:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287817344:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134708.472896:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287817344:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 20us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134708.472900:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 252 00010000:00010000:2.0:1787134709.184356:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134710.208300:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134711.168709:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311975552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134711.168809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134711.169102:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311975552 00000100:00100000:2.0:1787134711.169131:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311975552 00000100:00080000:1.0:1787134711.169313:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134711.169740:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787134711.169755:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311975552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787134711.169808:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134711.172246:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311975552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2471us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134711.172275:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787134711.175467:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81bc2300 x1873946311975552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134711.175512:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311975552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787134711.232600:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134712.257278:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134712.705593:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311975936:0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.705709:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134712.705793:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134712.705801:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4daf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311976064:0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.705830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134712.705876:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311975936 00000100:00100000:3.0:1787134712.705886:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311975936 00000100:00100000:3.0:1787134712.705961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787134712.705972:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311975936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.706037:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311975936:12345-0@lo:400:kworker.0 Request processed in 67us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134712.706046:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787134712.706076:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311976064 00000100:00100000:3.0:1787134712.706080:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311976064 00000100:00100000:3.0:1787134712.706108:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787134712.706115:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311976064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.706147:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311976064:12345-0@lo:400:kworker.0 Request processed in 33us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134712.706154:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787134712.706204:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787134712.706261:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa4daf8a80 x1873946311976064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134712.706277:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4daf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311976064:0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.706289:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311975936:0@lo:400:kworker.0 00000100:00100000:0.0:1787134712.706443:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4daf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311975680:0@lo:400:kworker.0 00000100:00100000:0.0:1787134712.706491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134712.706521:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311976192:0@lo:400:kworker.0 00000100:00100000:0.0:1787134712.706548:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134712.706568:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787134712.706575:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311975808:0@lo:400:kworker.0 00000100:00100000:0.0:1787134712.706600:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134712.706616:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311976320:0@lo:400:kworker.0 00000100:00100000:0.0:1787134712.706640:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134712.706672:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311975680 00000100:00100000:0.0:1787134712.706677:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311975680 00000100:00100000:0.0:1787134712.706719:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787134712.706727:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311975680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134712.706768:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311975680:12345-0@lo:400:kworker.0 Request processed in 42us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134712.706776:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787134712.706813:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4daf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311975680:0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.707009:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311976192 00000100:00100000:3.0:1787134712.707034:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311976192 00000100:00100000:3.0:1787134712.707084:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311975808 00000100:00100000:3.0:1787134712.707088:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311975808 00000100:00100000:3.0:1787134712.707101:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787134712.707108:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311976192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.707150:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311976192:12345-0@lo:400:kworker.0 Request processed in 42us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134712.707184:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787134712.707198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787134712.707204:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311975808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.707248:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311975808:12345-0@lo:400:kworker.0 Request processed in 42us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134712.707254:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787134712.707272:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311976320 00000100:00100000:3.0:1787134712.707276:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311976320 00000100:00100000:3.0:1787134712.707301:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787134712.708488:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311976320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.708569:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311976320:12345-0@lo:400:kworker.0 Request processed in 1259us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134712.708579:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787134712.708656:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311975808:0@lo:400:kworker.0 00010000:00080000:3.0:1787134712.708674:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942763b80 x1873946311976320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134712.708686:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311976320:0@lo:400:kworker.0 00000100:00100000:3.0:1787134712.708698:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311976192:0@lo:400:kworker.0 00000100:00080000:0.0:1787134712.709555:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134712.709566:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787134712.853042:0:11457:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 06:18:31 (1787134711) === 00000100:00100000:2.0:1787134713.217628:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787134713.217665:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311976448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134713.217780:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134713.218030:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311976448 00000100:00100000:3.0:1787134713.218042:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311976448 00000100:00100000:3.0:1787134713.218106:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787134713.218117:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311976448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134713.218194:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134713.218535:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311976448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 420us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134713.218544:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787134713.218624:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942761500 x1873946311976448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134713.218650:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311976448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134713.233400:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134713.233618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287817728 00000100:00100000:3.0:1787134713.233635:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287817728 00000100:00100000:3.0:1787134713.233736:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:3.0:1787134713.233751:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287817728:12345-192.168.202.36@tcp:41:mkdir.0 00000004:00000024:3.0:1787134713.233826:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787134713.233963:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287817728:12345-192.168.202.36@tcp:41:mkdir.0 Request processed in 216us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134713.233972:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00080000:0.0:1787134713.234037:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134713.235136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.235570:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287817856 00000100:00100000:1.0:1787134713.235583:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287817856 00000100:00100000:1.0:1787134713.235644:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787134713.235655:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:486fb1ad-4266-4864-b299-111c5140734b+6:9693:x1873946287817856:12345-192.168.202.36@tcp:700:mkdir.0 00000100:00100000:1.0:1787134713.235766:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:486fb1ad-4266-4864-b299-111c5140734b+6:9693:x1873946287817856:12345-192.168.202.36@tcp:700:mkdir.0 Request processed in 112us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134713.235774:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:3.0:1787134713.248795:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134713.248848:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287818112 00000100:00100000:0.0:1787134713.248859:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287818112 00000100:00100000:0.0:1787134713.248980:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:0.0:1787134713.248992:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:9693:x1873946287818112:12345-192.168.202.36@tcp:36:mkdir.0 00010000:00010000:0.0:1787134713.249073:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134713.249154:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905dc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701ec expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.249203:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7c500) 00010000:00010000:0.0:1787134713.249231:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787134713.249608:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.249621:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.249641:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.249651:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.249656:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.249660:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134713.250695:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787134713.250708:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.250720:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.250725:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.250729:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134713.250733:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.250739:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.250747:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:0.0:1787134713.250749:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134713.250752:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.250756:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae905ee2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787134713.250769:0:5836:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000085302bd2 reply state 000000000730157d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134713.250776:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787134713.250882:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+7:9693:x1873946287818112:12345-192.168.202.36@tcp:36:mkdir.0 Request processed in 1891us (2097us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787134713.250888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00010000:00010000:3.0:1787134713.255392:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.255412:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.255421:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.255427:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134713.255446:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.255455:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.255472:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98aa44db2f00) 00010000:00010000:3.0:1787134713.255475:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134713.255480:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.255487:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae905ee9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.280417:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134713.281848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.281948:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287818240 00000100:00100000:1.0:1787134713.281966:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287818240 00000100:00100000:1.0:1787134713.282054:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:1.0:1787134713.282076:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:9694:x1873946287818240:12345-192.168.202.36@tcp:101:chmod.0 00010000:00010000:1.0:1787134713.282111:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134713.282147:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905ef0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070271 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.282292:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905ef7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.282311:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.282336:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134713.282426:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787134713.282432:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134713.282487:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.282520:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905ef0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070271 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.282543:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070271 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.282571:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:1.0:1787134713.282575:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134713.282580:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea800, rc 0) 00000100:00100000:1.0:1787134713.282673:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+7:9694:x1873946287818240:12345-192.168.202.36@tcp:101:chmod.0 Request processed in 609us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134713.282682:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787134713.286198:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134713.286533:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287818496 00000100:00100000:3.0:1787134713.286545:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287818496 00000100:00100000:3.0:1787134713.286609:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:3.0:1787134713.286620:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+7:9694:x1873946287818496:12345-192.168.202.36@tcp:36:chmod.0 00010000:00010000:3.0:1787134713.286676:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134713.286707:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905ef7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070271 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.286727:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:3.0:1787134713.286738:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787134713.286764:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.286777:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.286805:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787134713.287088:0:5836:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000008efffbf0 reply state 000000005deb57d2 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134713.287096:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787134713.287106:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787134713.287288:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+8:9694:x1873946287818496:12345-192.168.202.36@tcp:36:chmod.0 Request processed in 666us (1142us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787134713.287299:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00010000:00010000:0.0:1787134713.296826:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.296856:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.296865:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.296871:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134713.296875:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.296880:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.296894:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cf00) 00010000:00010000:0.0:1787134713.296896:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787134713.296900:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.296905:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905efe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134713.315334:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.315997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287818624 00000100:00100000:1.0:1787134713.316011:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287818624 00000100:00100000:1.0:1787134713.316097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:1.0:1787134713.316110:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+7:9695:x1873946287818624:12345-192.168.202.36@tcp:101:chown.0 00010000:00010000:1.0:1787134713.316144:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134713.316393:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070278 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.316807:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae905f0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.316830:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae905f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.316844:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae905f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134713.316929:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787134713.316934:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134713.316988:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae905f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.317045:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070278 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.317068:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae905f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070278 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.317077:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:1.0:1787134713.317081:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134713.317085:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deba00, rc 0) 00000100:00100000:1.0:1787134713.317235:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+8:9695:x1873946287818624:12345-192.168.202.36@tcp:101:chown.0 Request processed in 1127us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134713.317243:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:2.0:1787134713.327327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134713.327562:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287818752 00000100:00100000:3.0:1787134713.327577:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287818752 00000100:00100000:3.0:1787134713.327654:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:3.0:1787134713.327668:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+8:9695:x1873946287818752:12345-192.168.202.36@tcp:101:chown.0 00010000:00010000:3.0:1787134713.327701:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134713.327734:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae905f13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907027f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.327871:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.327891:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.327906:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.327926:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.327949:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.327958:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328103:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae905f28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328112:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae905f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328119:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae905f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134713.328221:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787134713.328225:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787134713.328623:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae905f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328643:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328651:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328659:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328665:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134713.328671:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328688:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328704:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:3.0:1787134713.328707:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134713.328714:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328721:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b200/0x69932dacae905f1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328739:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328746:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328752:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328757:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7be00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134713.328760:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328766:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328773:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98aa42a7cf00) 00010000:00010000:3.0:1787134713.328776:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134713.328779:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328795:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7be00/0x69932dacae905f21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328837:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae905f13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907027f expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328855:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae905f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907027f expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.328862:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa42a7c500) 00010000:00010000:3.0:1787134713.328865:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787134713.328867:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7bc00, rc 0) 00000100:00100000:3.0:1787134713.328963:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+9:9695:x1873946287818752:12345-192.168.202.36@tcp:101:chown.0 Request processed in 1297us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134713.328973:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:3.0:1787134713.344604:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.344932:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287819008 00000100:00100000:1.0:1787134713.344947:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287819008 00000100:00100000:1.0:1787134713.345031:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:1.0:1787134713.345043:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+9:9695:x1873946287819008:12345-192.168.202.36@tcp:36:chown.0 00010000:00010000:1.0:1787134713.345135:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134713.345233:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae905f28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907027f expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.345260:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa42a7c500) 00010000:00010000:1.0:1787134713.345277:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134713.345312:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.345673:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.345711:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787134713.470914:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1787134713.470941:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787134713.471056:0:5835:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000094f84bd5 reply state 000000008f90e3f6 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134713.471075:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787134713.471401:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787134713.471570:0:5835:0:(ldlm_lib.c:3459:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787134713.471600:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+7:9695:x1873946287819008:12345-192.168.202.36@tcp:36:chown.0 Request processed in 126551us (127007us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787134713.471612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00010000:00010000:1.0:1787134713.471667:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.471678:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.471687:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.471694:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134713.471700:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.471709:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.471731:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa50adef00) 00010000:00010000:1.0:1787134713.471735:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787134713.471753:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.471760:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134713.493063:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134713.493548:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287819136 00000100:00100000:0.0:1787134713.493566:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287819136 00000100:00100000:0.0:1787134713.493661:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:0.0:1787134713.493675:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+6:9696:x1873946287819136:12345-192.168.202.36@tcp:101:touch.500 00010000:00010000:0.0:1787134713.493710:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134713.493737:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae905f36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070286 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787134713.496586:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2747us 00010000:00010000:2.0:1787134713.555821:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.555860:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.555877:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.555900:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.555907:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.555929:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.556834:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae905f4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.556849:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae905f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.556861:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae905f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134713.556988:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787134713.556994:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134713.557216:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae905f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.557235:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.557242:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.557250:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.557256:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134713.557262:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.557271:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.557296:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:2.0:1787134713.557299:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134713.557304:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.557310:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae905f3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.560848:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.560873:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.560883:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.560890:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134713.560896:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.560906:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.560930:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98aa59e99000) 00010000:00010000:2.0:1787134713.560933:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134713.560940:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.560947:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae905f44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.561067:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae905f36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070286 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.561090:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae905f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070286 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.561099:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:2.0:1787134713.561102:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787134713.561105:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96600, rc 0) 00000100:00100000:2.0:1787134713.561273:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+7:9696:x1873946287819136:12345-192.168.202.36@tcp:101:touch.500 Request processed in 67599us (68224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134713.561285:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:2.0:1787134713.566641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.566747:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287819392 00000100:00100000:1.0:1787134713.566764:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287819392 00000100:00100000:1.0:1787134713.566858:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:1.0:1787134713.566871:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+7:9696:x1873946287819392:12345-192.168.202.36@tcp:101:touch.500 00010000:00010000:1.0:1787134713.566908:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134713.566942:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907028d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.567657:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.567680:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.567696:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.567713:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.567720:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.567727:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787134713.573735:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787134713.576354:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905f67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576389:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576415:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576502:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576511:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576519:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576526:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134713.576531:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576541:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576556:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:1.0:1787134713.576560:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134713.576566:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576597:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905f59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134713.576619:0:5835:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000000b7aef6 reply state 0000000058e6a4af transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134713.576632:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787134713.576693:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905f52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907028d expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576711:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907028d expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.576720:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98aa50ade900) 00010000:00010000:1.0:1787134713.576723:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134713.576726:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb400, rc 0) 00000100:00100000:1.0:1787134713.576835:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+10:9696:x1873946287819392:12345-192.168.202.36@tcp:101:touch.500 Request processed in 9967us (10210us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787134713.576846:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00010000:00010000:1.0:1787134713.585379:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.585415:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.585426:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.585434:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deac00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134713.585462:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.585473:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.585500:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff98aa50adef00) 00010000:00010000:1.0:1787134713.585503:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134713.585510:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.585517:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134713.593012:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134713.593075:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134713.593111:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134713.593317:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287819776 00000100:00100000:0.0:1787134713.593337:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287819776 00000100:00100000:0.0:1787134713.593409:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 254 00000100:00100000:0.0:1787134713.593419:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287819776:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134713.593510:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287819776:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 92us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134713.593518:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 254 00000100:00100000:1.0:1787134713.593995:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287819648 00000100:00100000:1.0:1787134713.594007:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287819648 00000100:00100000:1.0:1787134713.594076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287819904 00000100:00100000:1.0:1787134713.594081:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287819904 00000100:00100000:0.0:1787134713.594100:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:0.0:1787134713.594113:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+9:9696:x1873946287819648:12345-192.168.202.36@tcp:36:touch.500 00000100:00100000:1.0:1787134713.594134:0:5836:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787134713.594147:0:5836:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00010000:0.0:1787134713.594199:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134713.594354:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905f67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907028d expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134713.594372:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 118 00010000:00010000:0.0:1787134713.594375:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98aa50ade900) 00000100:00100000:1.0:1787134713.594388:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287819904:12345-192.168.202.36@tcp:400:kworker.0 00010000:00010000:0.0:1787134713.594390:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787134713.594438:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.594450:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.594457:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787134713.594593:0:5835:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000070ae8c72 reply state 00000000815e49eb transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134713.594617:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287819904:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 232us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134713.594628:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:0.0:1787134713.594641:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787134713.594812:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+10:9696:x1873946287819648:12345-192.168.202.36@tcp:36:touch.500 Request processed in 700us (1816us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787134713.594819:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00080000:2.0:1787134713.595308:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134713.607325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134713.607451:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287820032 00000100:00100000:3.0:1787134713.607466:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287820032 00000100:00100000:3.0:1787134713.607551:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:3.0:1787134713.607565:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+10:9696:x1873946287820032:12345-192.168.202.36@tcp:101:touch.500 00010000:00010000:3.0:1787134713.607598:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134713.607626:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae905f7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070294 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.607714:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae905f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070294 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.607753:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae905f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070294 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134713.607780:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:3.0:1787134713.607785:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787134713.607790:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7ae00, rc 0) 00000100:00100000:3.0:1787134713.607882:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+11:9696:x1873946287820032:12345-192.168.202.36@tcp:101:touch.500 Request processed in 320us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134713.607891:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 24 00010000:00010000:1.0:1787134713.613544:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.613572:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.613617:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.613624:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134713.613632:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.613641:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.613667:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:1.0:1787134713.613671:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134713.613677:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.613684:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae905f75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134713.615585:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134713.615830:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287820160 00000100:00100000:3.0:1787134713.615846:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287820160 00000100:00100000:3.0:1787134713.615915:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:3.0:1787134713.615925:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1873946287820160:12345-192.168.202.36@tcp:8:touch.500 00010000:00080000:3.0:1787134713.615971:0:6682:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from 486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:3.0:1787134713.616016:0:6682:0:(genops.c:1406:class_connect()) connect: client 486fb1ad-4266-4864-b299-111c5140734b, cookie 0x69932dacae905f83 00002000:00100000:3.0:1787134713.616032:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 486fb1ad-4266-4864-b299-111c5140734b/ffff98aa551b1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787134713.616046:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1787134713.616706:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787134713.616762:0:6682:0:(import.c:65:import_set_state_nolock()) ffff98aa551b4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787134713.616874:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2348:x1873946287820160:12345-192.168.202.36@tcp:8:touch.500 Request processed in 947us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134713.616886:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:0.0:1787134713.640399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134713.640647:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287820288 00000100:00100000:3.0:1787134713.640661:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287820288 00000100:00100000:3.0:1787134713.640779:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:3.0:1787134713.640793:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:0:x1873946287820288:12345-192.168.202.36@tcp:2:touch.500 00000100:00080000:2.0:1787134713.641225:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134713.717072:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:0:x1873946287820288:12345-192.168.202.36@tcp:2:touch.500 Request processed in 76261us (76666us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787134713.717091:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000001:00080000:3.0:1787134713.717155:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1787134713.717198:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000100:00100000:3.0:1787134713.722675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.723215:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287820544 00000100:00100000:1.0:1787134713.723232:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287820544 00000100:00100000:1.0:1787134713.723309:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:1.0:1787134713.723322:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+10:9696:x1873946287820544:12345-192.168.202.36@tcp:35:touch.500 00000100:00100000:1.0:1787134713.726316:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+11:9696:x1873946287820544:12345-192.168.202.36@tcp:35:touch.500 Request processed in 2764us (3426us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787134713.726336:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:3.0:1787134713.755694:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134713.755840:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287820672 00000100:00100000:0.0:1787134713.755854:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287820672 00000100:00100000:0.0:1787134713.755924:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787134713.755935:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+11:9697:x1873946287820672:12345-192.168.202.36@tcp:101:rm.0 00010000:00010000:0.0:1787134713.755970:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134713.755998:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae905f8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907029b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.756089:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae905f91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.756106:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae905f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.756121:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae905f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134713.756242:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787134713.756247:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134713.756719:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae905f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.756760:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae905f8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907029b expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.756804:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae905f91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907029b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.756814:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:0.0:1787134713.756818:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787134713.756822:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451e00, rc 0) 00000100:00100000:0.0:1787134713.756915:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+12:9697:x1873946287820672:12345-192.168.202.36@tcp:101:rm.0 Request processed in 982us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134713.756923:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787134713.769891:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.770389:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287820928 00000100:00100000:1.0:1787134713.770414:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287820928 00000100:00100000:1.0:1787134713.770503:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:1.0:1787134713.770515:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+12:9697:x1873946287820928:12345-192.168.202.36@tcp:101:rm.0 00010000:00010000:1.0:1787134713.770565:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134713.770600:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702a2 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134713.770766:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787134713.770994:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702a2 expref: 14 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.771013:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:1.0:1787134713.771016:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134713.771022:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905f98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702a2 expref: 14 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.771041:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deac00, rc 0) 00000100:00100000:1.0:1787134713.771247:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+13:9697:x1873946287820928:12345-192.168.202.36@tcp:101:rm.0 Request processed in 734us (1372us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787134713.771256:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:3.0:1787134713.777730:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.777930:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287821056 00000100:00100000:1.0:1787134713.777947:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287821056 00000100:00100000:1.0:1787134713.778089:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:1.0:1787134713.778112:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+13:9697:x1873946287821056:12345-192.168.202.36@tcp:37:rm.0 00000100:00100000:1.0:1787134713.796826:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+13:9697:x1873946287821056:12345-192.168.202.36@tcp:37:rm.0 Request processed in 18695us (19094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134713.796844:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:2.0:1787134713.804672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134713.804810:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287821312 00000100:00100000:0.0:1787134713.804824:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287821312 00000100:00100000:0.0:1787134713.804897:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:0.0:1787134713.804907:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa50e43450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+13:9697:x1873946287821312:12345-192.168.202.36@tcp:35:rm.0 00000100:00100000:0.0:1787134713.805281:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa50e43450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+14:9697:x1873946287821312:12345-192.168.202.36@tcp:35:rm.0 Request processed in 374us (624us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787134713.805291:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:3.0:1787134713.809482:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134713.814282:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287821568 00000100:00100000:0.0:1787134713.814304:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287821568 00000100:00100000:0.0:1787134713.814409:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:0.0:1787134713.814423:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+14:9697:x1873946287821568:12345-192.168.202.36@tcp:101:rm.0 00010000:00010000:0.0:1787134713.814462:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134713.814498:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae905fa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.814947:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae905fad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.814965:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae905fad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.815032:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae905fad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134713.815047:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787134713.821555:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae905fa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702a9 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.821607:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae905fad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702a9 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.821646:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:2.0:1787134713.821649:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787134713.821654:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450200, rc 0) 00000100:00100000:2.0:1787134713.821772:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+16:9697:x1873946287821568:12345-192.168.202.36@tcp:101:rm.0 Request processed in 7350us (12304us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787134713.821783:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:2.0:1787134713.834319:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.834625:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287821696 00000100:00100000:1.0:1787134713.834638:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287821696 00000100:00100000:1.0:1787134713.834702:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:1.0:1787134713.834724:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+16:9697:x1873946287821696:12345-192.168.202.36@tcp:41:rm.0 00000004:00000024:1.0:1787134713.834803:0:11472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787134713.834886:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+16:9697:x1873946287821696:12345-192.168.202.36@tcp:41:rm.0 Request processed in 164us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134713.834891:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:0.0:1787134713.838657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.838803:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287821824 00000100:00100000:1.0:1787134713.838819:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287821824 00000100:00100000:1.0:1787134713.838955:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:1.0:1787134713.838968:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+16:9697:x1873946287821824:12345-192.168.202.36@tcp:101:rm.0 00010000:00010000:1.0:1787134713.839009:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134713.839038:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839134:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839154:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839236:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839260:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839268:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839274:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839471:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905fd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839477:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839482:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134713.839511:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787134713.839514:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134713.839543:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839554:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839562:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839567:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839572:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839576:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134713.839580:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839586:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839603:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:1.0:1787134713.839606:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134713.839610:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839615:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839626:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839629:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839633:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839637:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134713.839639:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839642:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839645:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff98aa50ade600) 00010000:00010000:1.0:1787134713.839646:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134713.839648:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839651:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839688:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702b0 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839699:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702b0 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.839705:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:1.0:1787134713.839706:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134713.839709:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb400, rc 0) 00000100:00100000:1.0:1787134713.839804:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+17:9697:x1873946287821824:12345-192.168.202.36@tcp:101:rm.0 Request processed in 838us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134713.839809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:2.0:1787134713.845826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134713.845885:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287822080 00000100:00100000:1.0:1787134713.845899:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287822080 00000100:00100000:1.0:1787134713.845978:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:1.0:1787134713.845991:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+17:9697:x1873946287822080:12345-192.168.202.36@tcp:36:rm.0 00010000:00010000:1.0:1787134713.846063:0:11472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787134713.846110:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae905fd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702b0 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846137:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae905f7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070294 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846199:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:1.0:1787134713.846514:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae905f91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907029b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846557:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:1.0:1787134713.846561:0:11472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134713.846592:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846611:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846623:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846638:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846645:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846651:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846811:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846819:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.846825:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787134713.847998:0:11472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787134713.848015:0:11472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329814855425ns, next at 330814852290ns, rc = 0 00010000:00010000:1.0:1787134713.848117:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848137:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848148:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848195:0:11472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848211:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848218:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848247:0:11472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787134713.848455:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848462:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848469:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848476:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134713.848481:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.848487:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134713.848490:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.848495:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.848502:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134713.848512:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848513:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98aa50adef00) 00010000:00010000:1.0:1787134713.848516:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787134713.848519:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848522:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.848528:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98aa50adef00) 00010000:00010000:1.0:1787134713.848529:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae905fe5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.848530:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787134713.848543:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.848549:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae905fec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848551:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848557:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848562:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.848565:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134713.848568:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deac00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134713.848570:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.848573:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134713.848576:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134713.848577:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848584:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:1.0:1787134713.848586:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134713.848589:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.848595:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae905fd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134713.848616:0:11472:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000050ee3e98 reply state 00000000c3a46b97 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134713.848626:0:11472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787134713.848752:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+16:9697:x1873946287822080:12345-192.168.202.36@tcp:36:rm.0 Request processed in 2759us (2933us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787134713.848762:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00010000:00010000:1.0:1787134713.851448:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.851465:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.851471:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.851474:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134713.851479:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.851484:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.851498:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff98aa50ade600) 00010000:00010000:1.0:1787134713.851500:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134713.851504:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134713.851507:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb600/0x69932dacae905fde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134713.853837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134713.853951:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287822336 00000100:00100000:0.0:1787134713.853964:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287822336 00000100:00100000:0.0:1787134713.854036:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:0.0:1787134713.854046:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+15:9697:x1873946287822336:12345-192.168.202.36@tcp:35:rm.0 00000100:00100000:0.0:1787134713.854459:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+16:9697:x1873946287822336:12345-192.168.202.36@tcp:35:rm.0 Request processed in 412us (635us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787134713.854470:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787134713.860802:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134713.860905:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287822592 00000100:00100000:2.0:1787134713.860919:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287822592 00000100:00100000:2.0:1787134713.861004:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:2.0:1787134713.861016:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+16:9697:x1873946287822592:12345-192.168.202.36@tcp:36:rm.0 00010000:00010000:2.0:1787134713.861108:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787134713.861146:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae905fad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702a9 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.861217:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae905f4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070286 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.861233:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:2.0:1787134713.861256:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae905f0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070278 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.861266:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:2.0:1787134713.861273:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134713.861311:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.861327:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.861337:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.861353:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.861378:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.861384:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.862420:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.862434:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.862443:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134713.863230:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787134713.863255:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863264:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863272:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863278:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134713.863285:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863294:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863321:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134713.863324:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787134713.863329:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863336:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906001 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863369:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863375:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863381:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863386:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134713.863389:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863394:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863400:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa59e99000) 00010000:00010000:2.0:1787134713.863403:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134713.863405:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134713.863411:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae905ff3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787134713.863433:0:5837:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000007af70cbc reply state 0000000066d7786c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134713.863443:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134713.863589:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+15:9697:x1873946287822592:12345-192.168.202.36@tcp:36:rm.0 Request processed in 2570us (2800us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787134713.863599:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00010000:00010000:0.0:1787134713.867547:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.867574:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.867585:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.867593:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134713.867618:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.867628:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.867651:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98aa59e99f00) 00010000:00010000:0.0:1787134713.867655:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134713.867660:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134713.867667:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae905ffa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134714.304536:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134715.330248:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134716.289333:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787134716.289375:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311976576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787134716.289494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134716.289607:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311976576 00000100:00100000:1.0:1787134716.289619:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311976576 00000100:00100000:1.0:1787134716.289732:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787134716.289746:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311976576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134716.289807:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134716.289879:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311976576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134716.289889:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787134716.289932:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81bc0e00 x1873946311976576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134716.289958:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311976576:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787134716.290460:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787134716.353484:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134717.376541:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134717.829051:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311977088:0@lo:400:kworker.0 00000100:00100000:3.0:1787134717.829151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134717.829236:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311976960:0@lo:400:kworker.0 00000100:00100000:1.0:1787134717.829280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134717.829451:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311976704:0@lo:400:kworker.0 00000100:00100000:0.0:1787134717.829495:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134717.829521:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311977216:0@lo:400:kworker.0 00000100:00100000:0.0:1787134717.829541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134717.829697:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311976832:0@lo:400:kworker.0 00000100:00100000:3.0:1787134717.831256:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311977088 00000100:00100000:3.0:1787134717.831272:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311977088 00000100:00100000:3.0:1787134717.831917:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787134717.831936:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311977088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134717.832068:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311977088:12345-0@lo:400:kworker.0 Request processed in 139us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134717.832076:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787134717.832155:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa42dd4a80 x1873946311977088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134717.832216:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311977088:0@lo:400:kworker.0 00000100:00100000:3.0:1787134717.832286:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311976704 00000100:00100000:3.0:1787134717.832311:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311976704 00000100:00100000:3.0:1787134717.832518:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787134717.832526:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311976704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134717.832569:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311976704:12345-0@lo:400:kworker.0 Request processed in 45us (3073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134717.832577:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787134717.836108:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311976704:0@lo:400:kworker.0 00000100:00100000:2.0:1787134717.838817:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134717.845464:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311977344:0@lo:400:kworker.0 00000100:00100000:2.0:1787134717.845562:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134717.845655:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311977344 00000100:00100000:2.0:1787134717.845666:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311977344 00000100:00100000:2.0:1787134717.845739:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787134717.845750:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311977344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134717.845814:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311977344:12345-0@lo:400:kworker.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134717.845824:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787134717.845849:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787134717.845885:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa42dd4e00 x1873946311977344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134717.845900:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311977344:0@lo:400:kworker.0 00000100:00100000:1.0:1787134717.848689:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311976960 00000100:00100000:1.0:1787134717.848710:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311976960 00000100:00100000:0.0:1787134717.851456:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311977216 00000100:00100000:0.0:1787134717.851476:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311977216 00000100:00100000:0.0:1787134717.851589:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311976832 00000100:00100000:0.0:1787134717.851594:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311976832 00000100:00100000:0.0:1787134717.851642:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787134717.851654:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311977216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134717.851793:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946311977216:12345-0@lo:400:kworker.0 Request processed in 141us (22249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134717.851801:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787134717.851820:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787134717.851827:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311976832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134717.851861:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311976832:12345-0@lo:400:kworker.0 Request processed in 34us (13056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134717.851868:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787134717.851939:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946311977216:0@lo:400:kworker.0 00000100:00100000:0.0:1787134717.852026:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787134717.852033:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311976960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134717.852087:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311976960:12345-0@lo:400:kworker.0 Request processed in 53us (22805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134717.852093:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787134717.853414:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311976960:0@lo:400:kworker.0 00000100:00080000:2.0:1787134717.855428:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134717.855512:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311976832:0@lo:400:kworker.0 00000004:00080000:1.0:1787134718.337362:0:7838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334304200193ns, next at 335304197605ns, rc = 0 00000100:00100000:1.0:1787134718.337399:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311977472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134718.337477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134718.337553:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311977472 00000100:00100000:1.0:1787134718.337561:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311977472 00000100:00100000:1.0:1787134718.337605:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787134718.337614:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311977472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134718.337646:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134718.337694:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311977472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134718.337701:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787134718.337742:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81bc2300 x1873946311977472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134718.337758:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311977472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787134718.401470:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134718.709575:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134718.709616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134718.709655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134718.709680:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134718.709712:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287822976 00000100:00100000:3.0:1787134718.709723:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287822976 00000100:00100000:3.0:1787134718.709789:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:3.0:1787134718.709800:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2350:x1873946287822976:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134718.709877:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2350:x1873946287822976:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134718.709885:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00080000:3.0:1787134718.709909:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787134718.710089:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287822848 00000100:00100000:2.0:1787134718.710094:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287822848 00000100:00100000:2.0:1787134718.710145:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287823104 00000100:00100000:2.0:1787134718.710148:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287823104 00000100:00100000:2.0:1787134718.710199:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:2.0:1787134718.710206:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+14:2350:x1873946287822848:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134718.710247:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+14:2350:x1873946287822848:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 42us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134718.710254:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:2.0:1787134718.710277:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:2.0:1787134718.710284:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287823104:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134718.710308:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287823104:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 25us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134718.710314:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:0.0:1787134718.710526:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287822720 00000100:00100000:0.0:1787134718.710531:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287822720 00000100:00100000:0.0:1787134718.710571:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 256 00000100:00100000:0.0:1787134718.710579:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287822720:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134718.710616:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287822720:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 39us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134718.710623:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 256 00000100:00080000:3.0:1787134718.714698:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1787134718.945686:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1787134718.945734:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1787134718.945770:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787134718.945796:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1787134718.946278:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311977600:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787134718.946397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134718.946760:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311977600 00000100:00100000:0.0:1787134718.946774:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311977600 00000100:00100000:0.0:1787134718.946858:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787134718.946870:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311977600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787134718.946906:0:6680:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787134718.946957:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8582fa, atime: 0x6a8582fa, ctime: 0x6a8582fa, blocks: 0x1 00010000:00010000:0.0:1787134718.946968:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134718.946993:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1787134718.947000:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134718.947008:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134718.947032:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134718.947044:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134718.947053:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134718.947074:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787134718.956945:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1873946311977600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10058us (10528us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787134718.956997:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787134718.957064:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134718.957076:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134718.957100:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450a00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134718.957105:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134718.957119:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134718.957384:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134718.957395:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae906008 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134718.957573:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134718.957577:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134718.957579:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787134718.977988:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa6aa8ea00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787134718.978016:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311977600:0@lo:6:osp-syn-1-0.0 00000001:02000400:3.0:1787134719.122658:0:11611:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787134719.424553:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134720.449235:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787134720.463947:0:11659:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd12cfdce0 20000000:00000080:3.0:1787134720.463967:0:11659:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98aa52a17000 uarg=0000000000000000 20000000:01000000:3.0:1787134720.464010:0:11659:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787134720.464018:0:11659:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787134720.464023:0:11659:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787134720.465406:0:11660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787134720.465569:0:11659:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787134720.470576:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787134720.470636:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787134720.470711:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787134720.470728:0:11659:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787134720.470750:0:11659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.470770:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070263 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.470779:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907026a expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.470787:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905eb8 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.470794:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905ec6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.470800:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae905ed4 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.470808:0:11659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.473402:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905ed4 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.473424:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905ed4 expref: 18 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134720.473441:0:11659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311977728:0@lo:104: 00000100:00100000:3.0:1787134720.473510:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787134720.473598:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905ec6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.473608:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905ec6 expref: 18 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134720.473617:0:11659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311977856:0@lo:104: 00000100:00100000:3.0:1787134720.473638:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787134720.473810:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae905eb8 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.473829:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae905eb8 expref: 18 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134720.473838:0:11659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311977984:0@lo:104: 00000100:00100000:3.0:1787134720.473864:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787134720.473942:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907026a expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.473952:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907026a expref: 12 pid: 5830 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134720.473962:0:11659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311978112:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134720.474033:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070263 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.474042:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070263 expref: 12 pid: 5829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134720.474049:0:11659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311978240:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134720.474099:0:11659:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a94279cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787134720.475069:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787134720.475107:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311977728 00000100:00100000:3.0:1787134720.475116:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311977728 00000100:00100000:3.0:1787134720.475310:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311977856 00000100:00100000:3.0:1787134720.475315:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311977856 00000100:00100000:3.0:1787134720.475329:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311977984 00000100:00100000:3.0:1787134720.475332:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311977984 00000100:00100000:3.0:1787134720.475346:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787134720.475355:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:11659:x1873946311977728:12345-0@lo:104: 00010000:00010000:3.0:1787134720.475369:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.475443:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787134720.475449:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+5:11659:x1873946311977728:12345-0@lo:104: Request processed in 96us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134720.475456:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787134720.475474:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787134720.475480:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:11659:x1873946311977856:12345-0@lo:104: 00010000:00010000:3.0:1787134720.475488:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.475519:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787134720.475524:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+4:11659:x1873946311977856:12345-0@lo:104: Request processed in 45us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134720.475530:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787134720.475543:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787134720.475549:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa742a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:11659:x1873946311977984:12345-0@lo:104: 00010000:00010000:3.0:1787134720.475566:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.475592:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787134720.475596:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa742a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+3:11659:x1873946311977984:12345-0@lo:104: Request processed in 49us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134720.475602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787134720.475747:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787134720.475756:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475764:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b400 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134720.475768:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475787:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134720.475795:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134720.475801:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787134720.475844:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475851:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134720.475876:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475883:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b400/0x69932dacae905ed4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905edb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475898:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787134720.475901:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475907:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fc600 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134720.475910:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475916:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134720.475922:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134720.475933:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787134720.475948:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475954:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134720.475960:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475967:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa413fc600/0x69932dacae905ec6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475978:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134720.475982:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475987:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa413fd200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134720.475990:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.475996:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134720.476001:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134720.476006:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787134720.476017:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.476022:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787134720.476045:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.476052:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa413fd200/0x69932dacae905eb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae905ebf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.476065:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134720.476067:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134720.476068:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134720.476085:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311978368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787134720.476149:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134720.476218:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134720.476223:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311978496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787134720.476246:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134720.476299:0:11659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311977728:0@lo:104: 00000100:00100000:0.0:1787134720.476309:0:11659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311977856:0@lo:104: 00000100:00100000:0.0:1787134720.476317:0:11659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311977984:0@lo:104: 00000100:00100000:3.0:1787134720.476446:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311978368 00000100:00100000:3.0:1787134720.476452:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311978368 00010000:00010000:3.0:1787134720.476475:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905ed4 expref: 19 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134720.476505:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311978496 00000100:00100000:3.0:1787134720.476508:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311978496 00010000:00010000:3.0:1787134720.476813:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905ec6 expref: 20 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134720.476837:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787134720.476844:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+20:3309:x1873946311978368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134720.476857:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134720.476861:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905ed4 expref: 20 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.476872:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905ed4 expref: 20 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.476888:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59deb800/0x69932dacae905edb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905ed4 expref: 20 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.476904:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134720.476950:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946311978368:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134720.476957:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787134720.476972:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787134720.476978:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3309:x1873946311978496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134720.476985:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134720.476989:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905ec6 expref: 18 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.476997:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905ec6 expref: 18 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.477006:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea400/0x69932dacae905ecd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905ec6 expref: 18 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.477014:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134720.477035:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:3309:x1873946311978496:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134720.477041:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787134720.477278:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134720.477287:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134720.477299:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311978624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787134720.477333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134720.477406:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311978624 00000100:00100000:0.0:1787134720.477412:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311978624 00010000:00010000:0.0:1787134720.477430:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905eb8 expref: 17 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134720.477459:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787134720.477466:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa47facc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:3308:x1873946311978624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787134720.477475:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134720.477480:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae905eb8 expref: 17 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.477501:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae905eb8 expref: 17 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.477511:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59deae00/0x69932dacae905ebf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae905eb8 expref: 17 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.477520:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134720.477547:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa47facc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:3308:x1873946311978624:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134720.477554:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787134720.477639:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311978624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134720.477704:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311978496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134720.477718:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946311978368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134720.478557:0:11659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311978112:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134720.478567:0:11659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1873946311978240:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134720.478601:0:11659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134720.479738:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134720.479779:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134720.479807:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287823232 00000100:00100000:0.0:1787134720.479814:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287823232 00010000:00010000:0.0:1787134720.479846:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907026a expref: 13 pid: 5830 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134720.479872:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287823360 00000100:00100000:0.0:1787134720.479875:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287823360 00010000:00010000:0.0:1787134720.479886:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070263 expref: 14 pid: 5829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134720.479897:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:0.0:1787134720.479905:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+14:2352:x1873946287823232:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134720.479918:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134720.479923:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907026a expref: 14 pid: 5830 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.479952:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907026a expref: 14 pid: 5830 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.479970:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa81451000/0x69932dacae905eb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907026a expref: 14 pid: 5830 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134720.479985:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134720.480266:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:3.0:1787134720.480283:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287823360:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134720.480292:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134720.480297:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070263 expref: 13 pid: 5829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480306:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070263 expref: 13 pid: 5829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480315:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa413fca00/0x69932dacae905eaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070263 expref: 13 pid: 5829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480328:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480336:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480352:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480359:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480364:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480370:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480375:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7be00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134720.480379:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480391:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480405:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480414:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134720.480472:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:2352:x1873946287823232:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 566us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134720.480481:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:3.0:1787134720.480527:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:2352:x1873946287823360:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 246us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134720.480534:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00010000:00010000:3.0:1787134720.480559:0:11659:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480566:0:11659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134720.480572:0:11659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7be00/0x69932dacae90600f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134720.482513:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1787134721.409302:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134721.409338:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311978752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787134721.409452:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134721.409629:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311978752 00000100:00100000:1.0:1787134721.409640:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311978752 00000100:00100000:1.0:1787134721.409729:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787134721.409741:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311978752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134721.409793:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134721.409864:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311978752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134721.409873:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787134721.409975:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81bc0380 x1873946311978752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134721.410009:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311978752:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787134721.410763:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787134721.472770:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134721.592866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134721.593060:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287823488 00000100:00100000:2.0:1787134721.593074:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287823488 00000100:00100000:2.0:1787134721.593206:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 257 00000100:00100000:2.0:1787134721.593218:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:5593:x1873946287823488:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787134721.593274:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134721.593306:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa96200/0x69932dacae906016 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac90702b7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134721.593343:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa96200/0x69932dacae906016 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702b7 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134721.593355:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa96200/0x69932dacae906016 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702b7 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134721.593366:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96200, rc 0) 00000100:00100000:2.0:1787134721.593456:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287823488:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 240us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134721.593464:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 257 00000100:00100000:0.0:1787134721.601317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134721.601525:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287823616 00000100:00100000:2.0:1787134721.601540:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287823616 00000100:00100000:2.0:1787134721.601617:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 258 00000100:00100000:2.0:1787134721.601630:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287823616:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134721.604499:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134721.604617:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287823616:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 394us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134721.604637:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 258 00000100:00100000:2.0:1787134721.604713:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287823744 00000100:00100000:2.0:1787134721.604725:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287823744 00000100:00100000:2.0:1787134721.604826:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 259 00000100:00100000:2.0:1787134721.604837:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287823744:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787134721.605376:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287823744:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 538us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134721.605392:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 259 00000100:00100000:1.0:1787134721.615407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134721.615561:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287823872 00000100:00100000:2.0:1787134721.615577:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287823872 00000100:00100000:2.0:1787134721.615665:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 260 00000100:00100000:2.0:1787134721.615677:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:9968:x1873946287823872:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787134721.616064:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:9968:x1873946287823872:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 389us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134721.616073:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 260 00000100:00100000:1.0:1787134721.628612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134721.628807:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287824000 00000100:00100000:2.0:1787134721.628823:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287824000 00000100:00100000:2.0:1787134721.628910:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 261 00000100:00100000:2.0:1787134721.628923:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:9968:x1873946287824000:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787134721.629377:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:9968:x1873946287824000:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 456us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134721.629386:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 261 00000100:00100000:3.0:1787134721.635868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134721.636245:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287824128 00000100:00100000:1.0:1787134721.636270:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287824128 00000100:00100000:1.0:1787134721.636350:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 262 00000100:00100000:1.0:1787134721.636363:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:5593:x1873946287824128:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134721.636390:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134721.636418:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59dea400/0x69932dacae90601d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac90702be expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134721.636455:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea400/0x69932dacae90601d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702be expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134721.636469:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59dea400/0x69932dacae90601d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702be expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134721.636482:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea400, rc 0) 00000100:00100000:1.0:1787134721.636570:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287824128:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 208us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134721.636578:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 262 00000100:00100000:1.0:1787134721.639975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134721.640613:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287824256 00000100:00100000:0.0:1787134721.640630:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287824256 00000100:00100000:0.0:1787134721.640723:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 263 00000100:00100000:0.0:1787134721.640738:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287824256:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134721.641571:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287824256:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 829us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134721.641585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 263 00000100:00100000:0.0:1787134721.653527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134721.654288:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287824384 00000100:00100000:2.0:1787134721.654304:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287824384 00000100:00100000:2.0:1787134721.654390:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 264 00000100:00100000:2.0:1787134721.654402:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287824384:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787134721.654892:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:5593:x1873946287824384:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 489us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134721.654901:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 264 00000100:00100000:3.0:1787134721.659375:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134721.659673:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287824512 00000100:00100000:1.0:1787134721.659693:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287824512 00000100:00100000:1.0:1787134721.659796:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 265 00000100:00100000:1.0:1787134721.659813:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:9971:x1873946287824512:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787134721.660278:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:9971:x1873946287824512:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 468us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134721.660287:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 265 00000100:00100000:1.0:1787134721.667669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134721.668239:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287824640 00000100:00100000:0.0:1787134721.668255:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287824640 00000100:00100000:0.0:1787134721.668332:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 266 00000100:00100000:0.0:1787134721.668344:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:9971:x1873946287824640:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787134721.668703:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:9971:x1873946287824640:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 360us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134721.668720:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 266 10000000:01000000:3.0:1787134722.240367:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787134722.240379:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa52a7d800 from 7 10000000:01000000:3.0:1787134722.240386:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787134722.240483:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134722.240499:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134722.240515:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134722.240570:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311978880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787134722.240673:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134722.240758:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa412546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134722.240869:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311978880 00000100:00100000:2.0:1787134722.240880:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311978880 00000100:00100000:2.0:1787134722.240962:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787134722.240973:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:5832:x1873946311978880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787134722.240991:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134722.241013:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa97a00/0x69932dacae90602b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906024 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134722.241044:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa97a00/0x69932dacae90602b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906024 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134722.241058:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa97a00/0x69932dacae90602b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906024 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134722.241070:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97a00, rc 0) 00000100:00100000:2.0:1787134722.241193:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311978880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134722.241200:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787134722.241671:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311978880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134722.241694:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134722.241707:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134722.241811:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134722.241850:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134722.241962:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa412546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134722.242071:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311979008 00000100:00100000:1.0:1787134722.242079:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311979008 00000100:00100000:1.0:1787134722.242134:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787134722.242152:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311979008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.242558:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311979008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 415us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134722.242568:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787134722.243953:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134722.244050:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787134722.244220:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134722.244279:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa412546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134722.244501:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311979136 00000100:00100000:1.0:1787134722.244509:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311979136 00000100:00100000:1.0:1787134722.244573:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787134722.244584:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311979136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.244866:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311979136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134722.244876:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787134722.245199:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787134722.248499:0:11672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11672:1873946311979264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134722.248616:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134722.248721:0:11672:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa41254240 going to sleep for 11 seconds 00000100:00100000:0.0:1787134722.249033:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311979264 00000100:00100000:0.0:1787134722.249043:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311979264 00000100:00100000:0.0:1787134722.249112:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787134722.249133:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:11672:x1873946311979264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134722.252773:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:11672:x1873946311979264:12345-0@lo:502:llog_process_th.0 Request processed in 3635us (4141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134722.252794:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787134722.256479:0:11672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11672:1873946311979264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787134722.256555:0:11672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134722.256573:0:11672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134722.256575:0:11672:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787134722.256584:0:11672:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98aa52a7d800 00000020:00000080:3.0:1787134722.256587:0:11672:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787134722.256743:0:11672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11672:1873946311979392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787134722.256841:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134722.256901:0:11672:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa41254240 going to sleep for 11 seconds 00000100:00100000:2.0:1787134722.257027:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311979392 00000100:00100000:2.0:1787134722.257037:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311979392 00000100:00100000:2.0:1787134722.257120:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787134722.257141:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:11672:x1873946311979392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134722.257476:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:11672:x1873946311979392:12345-0@lo:502:llog_process_th.0 Request processed in 336us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134722.257484:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787134722.257653:0:11672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11672:1873946311979392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787134722.257676:0:11672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134722.257682:0:11672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134722.257683:0:11672:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787134722.257688:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787134722.257963:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787134722.257996:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787134722.258011:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134722.258024:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134722.258045:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787134722.258048:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa438c0800 from 7 10000000:01000000:2.0:1787134722.258051:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787134722.258095:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134722.258105:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134722.258119:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134722.258151:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787134722.258222:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134722.258253:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5075b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787134722.258375:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311979520 00000100:00100000:3.0:1787134722.258380:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311979520 00000100:00100000:3.0:1787134722.258407:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787134722.258415:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:5832:x1873946311979520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134722.258426:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134722.258445:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7b200/0x69932dacae906039 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906032 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134722.258473:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7b200/0x69932dacae906039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906032 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134722.258494:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7b200/0x69932dacae906039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906032 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134722.258503:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b200, rc 0) 00000100:00100000:3.0:1787134722.258527:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311979520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134722.258532:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787134722.261859:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787134722.261915:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134722.261932:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134722.262041:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787134722.262143:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134722.262239:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5075b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787134722.263576:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311979648 00000100:00100000:3.0:1787134722.264223:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311979648 00000100:00100000:3.0:1787134722.264322:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787134722.264335:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311979648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134722.264770:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311979648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 437us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134722.264780:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787134722.265278:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.265359:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.265429:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134722.265480:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54951780 going to sleep for 11 seconds 00000100:00100000:1.0:1787134722.265503:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311979776 00000100:00100000:1.0:1787134722.265511:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311979776 00000100:00100000:1.0:1787134722.265558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787134722.265568:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311979776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.265785:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311979776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134722.265793:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787134722.266000:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311979776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.266306:0:11674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11674:1873946311979904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134722.266351:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134722.266372:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311979904 00000100:00100000:1.0:1787134722.266376:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311979904 00000100:00100000:1.0:1787134722.266396:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787134722.266402:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:11674:x1873946311979904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134722.266549:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:11674:x1873946311979904:12345-0@lo:502:llog_process_th.0 Request processed in 146us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134722.266556:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787134722.266583:0:11674:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54951780 going to sleep for 11 seconds 00000100:00100000:1.0:1787134722.266594:0:11674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11674:1873946311979904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134722.266615:0:11674:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134722.266628:0:11674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134722.266631:0:11674:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787134722.266640:0:11674:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98aa438c0800 00000020:00000080:1.0:1787134722.266643:0:11674:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787134722.266717:0:11674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11674:1873946311980032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134722.266741:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134722.266754:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311980032 00000100:00100000:1.0:1787134722.266757:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311980032 00000100:00100000:1.0:1787134722.266770:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787134722.266774:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:11674:x1873946311980032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134722.266861:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:11674:x1873946311980032:12345-0@lo:502:llog_process_th.0 Request processed in 84us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134722.266867:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787134722.266899:0:11674:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54951780 going to sleep for 11 seconds 00000100:00100000:1.0:1787134722.266910:0:11674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11674:1873946311980032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134722.266925:0:11674:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134722.266929:0:11674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134722.266931:0:11674:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787134722.266935:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787134722.267004:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787134722.267033:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787134722.267047:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134722.267061:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134722.267074:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787134722.267079:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa4da38000 from 7 10000000:01000000:1.0:1787134722.267082:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787134722.267114:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134722.267136:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134722.267148:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134722.270219:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311980160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.271244:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134722.271330:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa438a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134722.271378:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311980160 00000100:00100000:1.0:1787134722.271406:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311980160 00000100:00100000:1.0:1787134722.271470:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787134722.271480:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:5832:x1873946311980160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134722.271503:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134722.271532:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59deb600/0x69932dacae906047 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906040 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134722.271577:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59deb600/0x69932dacae906047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906040 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134722.271595:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59deb600/0x69932dacae906047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906040 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134722.271609:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb600, rc 0) 00000100:00100000:1.0:1787134722.271680:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311980160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134722.271690:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787134722.271771:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311980160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134722.274515:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134722.274542:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134722.274675:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311980288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.274784:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134722.274843:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa438a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134722.274871:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311980288 00000100:00100000:1.0:1787134722.274892:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311980288 00000100:00100000:1.0:1787134722.274952:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787134722.274964:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311980288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.278310:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311980288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3332us (3510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134722.278333:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787134722.278444:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311980288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.278535:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311980416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134722.278600:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134722.278653:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa438a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134722.279331:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311980416 00000100:00100000:2.0:1787134722.279343:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311980416 00000100:00100000:2.0:1787134722.279418:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787134722.279429:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311980416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787134722.279686:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:5832:x1873946311980416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134722.279694:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787134722.279764:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5b817d2-f0c2-441a-949c-994c1ff95f2c:5832:1873946311980416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787134722.280030:0:11676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11676:1873946311980544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134722.280973:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134722.281038:0:11676:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5075b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787134722.282543:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311980544 00000100:00100000:1.0:1787134722.282565:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311980544 00000100:00100000:1.0:1787134722.282652:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787134722.282667:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:11676:x1873946311980544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134722.283055:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:11676:x1873946311980544:12345-0@lo:502:llog_process_th.0 Request processed in 391us (2979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134722.283066:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787134722.284302:0:11676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11676:1873946311980544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787134722.284359:0:11676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787134722.284372:0:11676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134722.284376:0:11676:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787134722.284384:0:11676:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98aa4da38000 00000020:00000080:2.0:1787134722.284387:0:11676:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787134722.284515:0:11676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11676:1873946311980672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134722.284600:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134722.284648:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311980672 00000100:00100000:2.0:1787134722.284656:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311980672 00000100:00100000:2.0:1787134722.284707:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787134722.284718:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:11676:x1873946311980672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134722.286448:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:11676:x1873946311980672:12345-0@lo:502:llog_process_th.0 Request processed in 1721us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134722.287738:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787134722.287842:0:11676:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa47320480 going to sleep for 11 seconds 00000100:00100000:2.0:1787134722.289683:0:11676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5b817d2-f0c2-441a-949c-994c1ff95f2c:11676:1873946311980672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787134722.289754:0:11676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787134722.289767:0:11676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134722.289770:0:11676:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787134722.289775:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787134722.289914:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787134722.289962:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787134722.289978:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134722.289994:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787134722.306487:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787134722.499230:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134722.945292:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311980800:0@lo:400:kworker.0 00000100:00100000:3.0:1787134722.945430:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134722.945651:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311980800 00000100:00100000:2.0:1787134722.945663:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311980800 00000100:00100000:2.0:1787134722.945765:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787134722.945777:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311980800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134722.947229:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311980928:0@lo:400:kworker.0 00000100:00100000:1.0:1787134722.947319:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134722.947450:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311980928 00000100:00100000:1.0:1787134722.947459:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311980928 00000100:00100000:1.0:1787134722.947533:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787134722.947545:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311980928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134722.947606:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311980928:12345-0@lo:400:kworker.0 Request processed in 63us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134722.947630:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1787134722.947652:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134722.947688:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311980928:0@lo:400:kworker.0 00000100:00100000:2.0:1787134722.952055:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311980800:12345-0@lo:400:kworker.0 Request processed in 6263us (6608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134722.952086:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787134722.952588:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311980800:0@lo:400:kworker.0 00000100:00100000:1.0:1787134722.952895:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134722.953058:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311981184:0@lo:400:kworker.0 00000100:00100000:1.0:1787134722.953188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134722.953248:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311981056:0@lo:400:kworker.0 00000100:00100000:1.0:1787134722.953275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134722.953333:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311981056 00000100:00100000:2.0:1787134722.953503:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311981184 00000100:00100000:2.0:1787134722.953512:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311981184 00000100:00100000:3.0:1787134722.953571:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311981056 00000100:00100000:2.0:1787134722.953586:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787134722.953597:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311981184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134722.953607:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787134722.953613:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311981056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787134722.953723:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134722.954452:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134722.954472:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311981312:0@lo:400:kworker.0 00000100:00100000:2.0:1787134722.954602:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311981184:12345-0@lo:400:kworker.0 Request processed in 1004us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134722.954613:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787134722.957260:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134722.957262:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311981056:12345-0@lo:400:kworker.0 Request processed in 3633us (3969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134722.957278:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787134722.957359:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311981184:0@lo:400:kworker.0 00010000:00080000:1.0:1787134722.957386:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d0e00 x1873946311981056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134722.957398:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311981056:0@lo:400:kworker.0 00000100:00100000:3.0:1787134722.960783:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311981312 00000100:00100000:3.0:1787134722.961347:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311981312 00000100:00080000:1.0:1787134722.961491:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134722.964583:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787134722.964624:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1873946311981312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134722.964770:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1873946311981312:12345-0@lo:400:kworker.0 Request processed in 168us (7514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134722.964778:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787134722.964929:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311981312:0@lo:400:kworker.0 00000040:00080000:2.0:1787134723.329072:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787134723.456883:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134723.456923:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311981440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134723.457034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134723.457240:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311981440 00000100:00100000:1.0:1787134723.457253:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311981440 00000100:00100000:1.0:1787134723.457329:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787134723.457342:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311981440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134723.457408:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134723.457483:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311981440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134723.457492:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787134723.457801:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311981440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134723.521011:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134723.829072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134723.829134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134723.829263:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287824768 00000100:00100000:2.0:1787134723.829285:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287824768 00000100:00100000:2.0:1787134723.829376:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 282 00000100:00100000:2.0:1787134723.829389:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287824768:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134723.829509:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287824768:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 122us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134723.829519:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 282 00000100:00100000:0.0:1787134723.830082:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134723.830131:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134723.830255:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287824896 00000100:00100000:3.0:1787134723.830262:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287824896 00000100:00100000:3.0:1787134723.830327:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287825152 00000100:00100000:3.0:1787134723.830330:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287825152 00000100:00100000:3.0:1787134723.830370:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 127 00000100:00100000:3.0:1787134723.830380:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287824896:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134723.830440:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287824896:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 62us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134723.830448:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 127 00000100:00100000:3.0:1787134723.830466:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 128 00000100:00100000:3.0:1787134723.830473:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2352:x1873946287825152:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134723.830499:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2352:x1873946287825152:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134723.830506:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 128 00000100:00080000:0.0:1787134723.831378:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134723.837733:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287825024 00000100:00100000:1.0:1787134723.837784:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287825024 00000100:00100000:1.0:1787134723.837919:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:1.0:1787134723.837934:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287825024:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134723.838087:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287825024:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 156us (8950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134723.838096:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00080000:0.0:1787134723.838671:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787134724.056207:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1787134724.545818:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134725.569776:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134726.528928:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311981568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134726.529057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134726.529461:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311981568 00000100:00100000:1.0:1787134726.529474:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311981568 00000100:00100000:1.0:1787134726.529565:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787134726.529577:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311981568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134726.529635:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134726.529699:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311981568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134726.529709:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1787134726.530081:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81bc0380 x1873946311981568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134726.530115:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311981568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787134726.530326:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787134726.594320:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134727.616807:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134728.064673:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311981824:0@lo:400:kworker.0 00000100:00100000:0.0:1787134728.064814:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134728.064903:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311982336:0@lo:400:kworker.0 00000100:00100000:0.0:1787134728.064935:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134728.064971:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134728.064978:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311981952:0@lo:400:kworker.0 00000100:00100000:0.0:1787134728.065004:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134728.065115:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311982080:0@lo:400:kworker.0 00000100:00100000:2.0:1787134728.065152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134728.065207:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787134728.065213:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311981696:0@lo:400:kworker.0 00000100:00100000:2.0:1787134728.065248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134728.065274:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa42dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1873946311982208:0@lo:400:kworker.0 00000100:00100000:2.0:1787134728.065298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134728.065334:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311982336 00000100:00100000:2.0:1787134728.065345:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311982336 00000100:00100000:2.0:1787134728.065411:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311982080 00000100:00100000:2.0:1787134728.065415:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311982080 00000100:00100000:2.0:1787134728.065443:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787134728.065454:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311982336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134728.065523:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311982336:12345-0@lo:400:kworker.0 Request processed in 70us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134728.065533:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787134728.065553:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787134728.065569:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311982080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134728.065603:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311982080:12345-0@lo:400:kworker.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134728.065610:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787134728.065630:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311981696 00000100:00100000:2.0:1787134728.065633:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311981696 00000100:00100000:2.0:1787134728.065656:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787134728.065661:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311981696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134728.065688:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311981696:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134728.065694:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787134728.065720:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311981824 00000100:00100000:2.0:1787134728.065723:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311981824 00000100:00100000:2.0:1787134728.065746:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311981952 00000100:00100000:2.0:1787134728.065748:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311981952 00000100:00100000:2.0:1787134728.065759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311982208 00000100:00100000:2.0:1787134728.065761:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311982208 00000100:00080000:0.0:1787134728.065969:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134728.066092:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787134728.066101:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98aa6aa8ea00, transno 4294967300 00000100:00100000:1.0:1787134728.066120:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311982336:0@lo:400:kworker.0 00000100:00100000:1.0:1787134728.066192:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311981696:0@lo:400:kworker.0 00010000:00080000:1.0:1787134728.066206:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa42dd7100 x1873946311982080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134728.066219:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311982080:0@lo:400:kworker.0 00000100:00100000:1.0:1787134728.066261:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787134728.066330:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787134728.066389:0:11472:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787134728.066401:0:11472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787134728.066421:0:5836:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787134728.066432:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1787134728.066736:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134728.066739:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134728.067712:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311981824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134728.067856:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311981824:12345-0@lo:400:kworker.0 Request processed in 1586us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134728.067868:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787134728.068288:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311981824:0@lo:400:kworker.0 00000100:00100000:2.0:1787134728.068585:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311981952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134728.068662:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311981952:12345-0@lo:400:kworker.0 Request processed in 2326us (3658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134728.068671:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787134728.068788:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311981952:0@lo:400:kworker.0 00000100:00100000:3.0:1787134728.068862:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873946311982208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134728.068935:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873946311982208:12345-0@lo:400:kworker.0 Request processed in 2497us (3636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134728.068944:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787134728.069029:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa42dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1873946311982208:0@lo:400:kworker.0 00000100:00100000:0.0:1787134728.577137:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311982464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134728.577282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134728.577627:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311982464 00000100:00100000:1.0:1787134728.577642:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311982464 00000100:00100000:1.0:1787134728.577723:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787134728.577735:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311982464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134728.577789:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134728.577860:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311982464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134728.577880:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787134728.577939:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311982464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787134728.641245:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134728.967755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134728.967960:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134728.968008:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134728.968078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134728.968343:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287825536 00000100:00100000:0.0:1787134728.968356:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287825536 00000100:00100000:0.0:1787134728.968466:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:0.0:1787134728.968480:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287825536:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134728.968583:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287825536:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 107us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134728.968591:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:0.0:1787134728.968746:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287825408 00000100:00100000:0.0:1787134728.968751:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287825408 00000100:00100000:0.0:1787134728.968790:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287825664 00000100:00100000:0.0:1787134728.968811:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287825664 00000100:00100000:0.0:1787134728.968838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 132 00000100:00100000:0.0:1787134728.968845:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287825408:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134728.968897:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287825408:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 53us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134728.968904:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 132 00000100:00100000:0.0:1787134728.968917:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 133 00000100:00100000:0.0:1787134728.968922:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287825664:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134728.968945:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287825664:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 23us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134728.968950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 133 00000100:00080000:2.0:1787134728.970128:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787134728.970141:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134728.971906:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287825280 00000100:00100000:3.0:1787134728.971927:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287825280 00000100:00100000:3.0:1787134728.972004:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 284 00000100:00100000:3.0:1787134728.972016:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287825280:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134728.972141:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287825280:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 127us (4402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134728.972149:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 284 00010000:00010000:0.0:1787134729.667182:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134730.688548:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134731.649057:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311982592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134731.649153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134731.649435:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311982592 00000100:00100000:1.0:1787134731.649444:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311982592 00000100:00100000:1.0:1787134731.649509:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787134731.649520:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311982592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134731.649564:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134731.649622:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311982592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134731.649629:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787134731.649671:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81bc3100 x1873946311982592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134731.649691:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311982592:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787134731.650294:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787134731.712592:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134732.740208:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134733.185807:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311982976:0@lo:400:kworker.0 00000100:00100000:1.0:1787134733.185968:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134733.186050:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311982720:0@lo:400:kworker.0 00000100:00100000:1.0:1787134733.186089:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787134733.186100:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311982848:0@lo:400:kworker.0 00000100:00100000:3.0:1787134733.186229:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311982976 00000100:00100000:3.0:1787134733.186240:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311982976 00000100:00100000:3.0:1787134733.186317:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787134733.186328:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311982976:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787134733.186631:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134733.186672:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311983104:0@lo:400:kworker.0 00000100:00100000:1.0:1787134733.190174:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134733.190688:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311983360:0@lo:400:kworker.0 00000100:00100000:1.0:1787134733.190759:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134733.190834:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311983360 00000100:00100000:1.0:1787134733.190844:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311983360 00000100:00100000:1.0:1787134733.191003:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787134733.191018:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311983360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134733.191186:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311983360:12345-0@lo:400:kworker.0 Request processed in 171us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134733.191194:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787134733.191251:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311983360:0@lo:400:kworker.0 00000100:00100000:1.0:1787134733.191302:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311982848 00000100:00100000:1.0:1787134733.191306:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311982848 00000100:00100000:1.0:1787134733.191335:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787134733.191341:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311982848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134733.191384:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311982848:12345-0@lo:400:kworker.0 Request processed in 43us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134733.191390:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787134733.191892:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311982848:0@lo:400:kworker.0 00000100:00080000:1.0:1787134733.192113:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134733.192885:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134733.192991:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311982720 00000100:00100000:0.0:1787134733.193002:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311982720 00000100:00100000:0.0:1787134733.193079:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787134733.193090:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311982720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134733.193189:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311982720:12345-0@lo:400:kworker.0 Request processed in 101us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134733.193197:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787134733.193270:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311982720:0@lo:400:kworker.0 00000100:00100000:0.0:1787134733.193284:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311983232:0@lo:400:kworker.0 00000100:00100000:0.0:1787134733.193319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134733.193367:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311983232 00000100:00100000:0.0:1787134733.193372:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311983232 00000100:00100000:0.0:1787134733.193414:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787134733.193422:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311983232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134733.193458:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311983232:12345-0@lo:400:kworker.0 Request processed in 37us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134733.193464:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787134733.193496:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311983232:0@lo:400:kworker.0 00000100:00080000:1.0:1787134733.194063:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134733.197558:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311982976:12345-0@lo:400:kworker.0 Request processed in 11216us (11575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134733.197581:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787134733.197685:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311982976:0@lo:400:kworker.0 00000100:00100000:2.0:1787134733.202726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134733.203213:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311983104 00000100:00100000:0.0:1787134733.203226:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311983104 00000100:00100000:0.0:1787134733.203314:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787134733.203327:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311983104:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787134733.203551:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f5d3480 x1873946311983104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134733.203568:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311983104:0@lo:400:kworker.0 00000100:00100000:0.0:1787134733.203615:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311983104:12345-0@lo:400:kworker.0 Request processed in 89us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134733.203624:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787134733.203715:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787134733.572712:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787134733.697503:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134733.697544:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311983488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134733.697683:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134733.698204:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311983488 00000100:00100000:1.0:1787134733.698221:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311983488 00000100:00100000:1.0:1787134733.698297:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787134733.698307:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311983488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134733.698358:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134733.698481:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311983488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134733.698489:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787134733.704329:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311983488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134733.761616:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134734.074580:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134734.074644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134734.074758:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287825920 00000100:00100000:1.0:1787134734.074772:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287825920 00000100:00100000:1.0:1787134734.074865:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 137 00000100:00100000:1.0:1787134734.074879:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287825920:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134734.074981:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287825920:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 105us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134734.074990:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 137 00000100:00100000:2.0:1787134734.075525:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287825792 00000100:00100000:2.0:1787134734.075532:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287825792 00000100:00100000:2.0:1787134734.075582:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 286 00000100:00100000:2.0:1787134734.075590:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287825792:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134734.075643:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287825792:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 53us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134734.075650:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 286 00000100:00080000:0.0:1787134734.075838:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134734.109180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134734.109270:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287826048 00000100:00100000:1.0:1787134734.109280:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287826048 00000100:00100000:1.0:1787134734.109346:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:1.0:1787134734.109355:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2348:x1873946287826048:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:1.0:1787134734.109385:0:6682:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905f83 00000100:00080000:1.0:1787134734.109393:0:6682:0:(import.c:65:import_set_state_nolock()) ffff98aa551b4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787134734.109435:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787134734.109704:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+2:2348:x1873946287826048:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 350us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134734.109727:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00010000:00010000:3.0:1787134734.109941:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787134734.110240:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134734.114975:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134734.117737:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287826176 00000100:00100000:0.0:1787134734.117759:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287826176 00000100:00100000:0.0:1787134734.117855:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 138 00000100:00100000:0.0:1787134734.117866:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2351:x1873946287826176:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134734.118009:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2351:x1873946287826176:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 144us (3052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134734.118026:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 138 00000100:00080000:1.0:1787134734.124799:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787134734.267368:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:3.0:1787134734.267379:0:7632:0:(genops.c:906:class_export_put()) final put ffff98aa551b1800/486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:1.0:1787134734.268564:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa551b1800/486fb1ad-4266-4864-b299-111c5140734b for lustre-OST0001 00000020:00000080:1.0:1787134734.268889:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa551b4000 for lustre-OST0001 00010000:00010000:0.0:1787134734.784725:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134735.808536:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134736.768799:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311983616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787134736.769076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134736.769219:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311983616 00000100:00100000:1.0:1787134736.769227:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311983616 00000100:00100000:1.0:1787134736.769301:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787134736.769311:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311983616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134736.769350:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134736.769394:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311983616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134736.769402:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787134736.770249:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81022d80 x1873946311983616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134736.770273:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311983616:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787134736.770948:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787134736.836239:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134737.856766:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134738.304778:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311983744:0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.304861:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134738.304919:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311984256:0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.304949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134738.305109:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787134738.305116:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311984128:0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.305140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134738.305539:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311984256 00000100:00100000:1.0:1787134738.305548:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311984256 00000100:00100000:1.0:1787134738.305611:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787134738.305622:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311984256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.305743:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311983872:0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.305775:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134738.305799:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311984384:0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.305820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134738.305840:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787134738.305845:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311984000:0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.305867:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134738.305892:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311983872 00000100:00100000:3.0:1787134738.305896:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311983872 00000100:00100000:3.0:1787134738.305940:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311984000 00000100:00100000:3.0:1787134738.305943:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311984000 00000100:00100000:3.0:1787134738.305969:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787134738.305984:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311983872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.306023:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311983872:12345-0@lo:400:kworker.0 Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134738.306030:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787134738.306048:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787134738.306054:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311984000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.306082:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311984000:12345-0@lo:400:kworker.0 Request processed in 28us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134738.306088:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787134738.306107:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311984128 00000100:00100000:3.0:1787134738.306111:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311984128 00000100:00100000:3.0:1787134738.306136:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311984384 00000100:00100000:3.0:1787134738.306139:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311984384 00000100:00100000:1.0:1787134738.306300:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311984256:12345-0@lo:400:kworker.0 Request processed in 680us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134738.306307:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787134738.306353:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787134738.306362:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311984128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.306395:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311984128:12345-0@lo:400:kworker.0 Request processed in 35us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134738.306454:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311983744 00000100:00100000:0.0:1787134738.306458:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311983744 00000100:00100000:0.0:1787134738.306489:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787134738.306496:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311983744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134738.306532:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311983744:12345-0@lo:400:kworker.0 Request processed in 37us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134738.306538:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787134738.306572:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311984000:0@lo:400:kworker.0 00000100:00100000:2.0:1787134738.306585:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311983872:0@lo:400:kworker.0 00000100:00100000:1.0:1787134738.309930:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787134738.309972:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311984384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134738.310102:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311984384:12345-0@lo:400:kworker.0 Request processed in 157us (4279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134738.310111:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787134738.310207:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311984384:0@lo:400:kworker.0 00000100:00080000:1.0:1787134738.310279:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787134738.310284:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787134738.310287:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134738.314925:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1787134738.315328:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81022680 x1873946311984128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134738.315345:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311984128:0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.315360:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311983744:0@lo:400:kworker.0 00000100:00100000:3.0:1787134738.315373:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311984256:0@lo:400:kworker.0 00000100:00100000:2.0:1787134738.816642:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311984512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134738.816789:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134738.816850:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311984512 00000100:00100000:1.0:1787134738.816859:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311984512 00000100:00100000:1.0:1787134738.816917:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787134738.816928:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311984512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134738.816979:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134738.817032:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311984512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134738.817040:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787134738.817287:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311984512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787134738.880795:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134739.194767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134739.194816:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134739.194845:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287826304 00000100:00100000:2.0:1787134739.194852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134739.194858:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287826304 00000100:00100000:0.0:1787134739.194932:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 288 00000100:00100000:0.0:1787134739.194944:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287826304:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134739.195034:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287826304:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134739.195043:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 288 00000100:00100000:1.0:1787134739.195154:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287826560 00000100:00100000:1.0:1787134739.195196:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287826560 00000100:00100000:1.0:1787134739.195242:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287826432 00000100:00100000:1.0:1787134739.195245:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287826432 00000100:00100000:1.0:1787134739.195267:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 142 00000100:00100000:1.0:1787134739.195276:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:602cf179-3fa4-4e4c-92db-c355fb291830+5:2351:x1873946287826560:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134739.195325:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:602cf179-3fa4-4e4c-92db-c355fb291830+5:2351:x1873946287826560:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 51us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134739.195332:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 142 00000100:00100000:1.0:1787134739.195345:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 143 00000100:00100000:1.0:1787134739.195352:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287826432:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134739.195378:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287826432:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134739.195385:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 143 00000100:00080000:1.0:1787134739.195400:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787134739.912118:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134740.950725:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134741.891809:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311984640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787134741.891888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134741.892481:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311984640 00000100:00100000:1.0:1787134741.892490:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311984640 00000100:00100000:1.0:1787134741.892561:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787134741.892573:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311984640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134741.892607:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134741.892674:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311984640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134741.892682:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787134741.892792:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787134741.892825:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81020a80 x1873946311984640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134741.892844:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311984640:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787134741.957786:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134742.981309:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134743.424569:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311985024:0@lo:400:kworker.0 00000100:00100000:2.0:1787134743.424667:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134743.424745:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787134743.424753:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311984896:0@lo:400:kworker.0 00000100:00100000:2.0:1787134743.424797:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134743.424815:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311985408:0@lo:400:kworker.0 00000100:00100000:2.0:1787134743.424839:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134743.425014:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311985024 00000100:00100000:1.0:1787134743.425023:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311985024 00000100:00100000:1.0:1787134743.425082:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311984896 00000100:00100000:1.0:1787134743.425085:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311984896 00000100:00100000:1.0:1787134743.425110:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787134743.425120:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311985024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134743.425207:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311985024:12345-0@lo:400:kworker.0 Request processed in 88us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134743.425215:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787134743.425231:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787134743.425238:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311984896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134743.425263:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311984896:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134743.425269:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787134743.425290:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311985408 00000100:00100000:1.0:1787134743.425293:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311985408 00000100:00100000:1.0:1787134743.425321:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787134743.425327:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311985408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134743.425358:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311985408:12345-0@lo:400:kworker.0 Request processed in 32us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134743.425372:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1787134743.425388:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787134743.425393:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134743.425434:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311984896:0@lo:400:kworker.0 00000100:00100000:1.0:1787134743.425445:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311985408:0@lo:400:kworker.0 00000100:00100000:1.0:1787134743.425454:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311985024:0@lo:400:kworker.0 00000100:00100000:3.0:1787134743.425630:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311985152:0@lo:400:kworker.0 00000100:00100000:3.0:1787134743.425665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134743.425698:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787134743.425704:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311984768:0@lo:400:kworker.0 00000100:00100000:3.0:1787134743.425731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134743.425753:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1873946311985280:0@lo:400:kworker.0 00000100:00100000:3.0:1787134743.425777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134743.425803:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311985280 00000100:00100000:3.0:1787134743.425807:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311985280 00000100:00100000:3.0:1787134743.425833:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787134743.425839:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873946311985280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134743.425874:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873946311985280:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134743.425894:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787134743.425919:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1873946311985280:0@lo:400:kworker.0 00000100:00100000:1.0:1787134743.426069:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311985152 00000100:00100000:1.0:1787134743.426074:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311985152 00000100:00100000:1.0:1787134743.426110:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787134743.426116:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311985152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134743.426154:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311985152:12345-0@lo:400:kworker.0 Request processed in 37us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134743.426181:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787134743.426198:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311984768 00000100:00100000:1.0:1787134743.426202:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311984768 00000100:00100000:1.0:1787134743.426224:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787134743.426231:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311984768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134743.426259:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311984768:12345-0@lo:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134743.426264:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:1.0:1787134743.426290:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787134743.426293:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134743.426308:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311984768:0@lo:400:kworker.0 00010000:00080000:1.0:1787134743.426319:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81d6fb80 x1873946311985152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787134759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134743.426341:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311985152:0@lo:400:kworker.0 00000040:00080000:3.0:1787134743.811719:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787134743.936533:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311985536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134743.936647:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134743.936813:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311985536 00000100:00100000:3.0:1787134743.936831:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311985536 00000100:00100000:3.0:1787134743.936898:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787134743.936908:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311985536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134743.936962:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134743.937483:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311985536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 573us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134743.937492:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787134743.937600:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311985536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787134744.000341:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134744.312804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134744.312948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134744.312985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134744.313015:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287826944 00000100:00100000:3.0:1787134744.313024:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287826944 00000100:00100000:3.0:1787134744.313075:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287826816 00000100:00100000:3.0:1787134744.313078:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287826816 00000100:00100000:3.0:1787134744.313101:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 147 00000100:00100000:3.0:1787134744.313110:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2352:x1873946287826944:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134744.313199:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:2352:x1873946287826944:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 89us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134744.313206:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 147 00000100:00100000:3.0:1787134744.313222:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 148 00000100:00100000:3.0:1787134744.313229:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287826816:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134744.313254:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287826816:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134744.313260:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 148 00000100:00080000:3.0:1787134744.313286:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134744.318113:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287826688 00000100:00100000:2.0:1787134744.318131:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287826688 00000100:00100000:2.0:1787134744.318200:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 290 00000100:00100000:2.0:1787134744.318211:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287826688:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134744.318298:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287826688:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 89us (5504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134744.318317:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 290 00000001:02000400:1.0:1787134744.735795:0:11843:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:19:03 (1787134743) 00010000:00010000:0.0:1787134745.024476:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134746.048356:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134746.600490:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134746.602489:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287827072 00000100:00100000:1.0:1787134746.602514:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287827072 00000100:00100000:1.0:1787134746.602616:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:1.0:1787134746.602630:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+5:10241:x1873946287827072:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787134746.602651:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134746.602675:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae90604e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702c5 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.602743:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906055 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.602770:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.602784:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787134746.603317:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787134746.604647:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787134746.604659:0:11472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134746.604813:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.605237:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae90604e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702c5 expref: 7 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.605265:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906055 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702c5 expref: 6 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.605285:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50aded00) 00010000:00010000:1.0:1787134746.605288:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134746.605292:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb800, rc 0) 00000100:00100000:1.0:1787134746.605554:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+6:10241:x1873946287827072:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 2926us (5071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134746.605564:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:2.0:1787134746.628060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134746.628205:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287827200 00000100:00100000:3.0:1787134746.628217:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287827200 00000100:00100000:0.0:1787134746.628694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:0.0:1787134746.628707:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+6:10242:x1873946287827200:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134746.628730:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134746.628763:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90605c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.628843:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.628858:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.628869:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.628884:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.628891:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.628908:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631051:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450800/0x69932dacae906071 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631071:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450800/0x69932dacae906071 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631082:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450800/0x69932dacae906071 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134746.631193:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787134746.631197:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134746.631364:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450800/0x69932dacae906071 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631384:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631391:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631399:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631405:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134746.631409:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631417:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631428:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50aded00) 00010000:00010000:0.0:1787134746.631431:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134746.631435:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631441:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631453:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631460:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631465:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631474:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134746.631477:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631483:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631490:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98aa44db2e00) 00010000:00010000:0.0:1787134746.631492:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134746.631495:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631506:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae90606a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631542:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90605c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702cc expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631555:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450800/0x69932dacae906071 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702cc expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134746.631562:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98aa44db2c00) 00010000:00010000:0.0:1787134746.631564:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787134746.631566:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450800, rc 0) 00000100:00100000:0.0:1787134746.631640:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+7:10242:x1873946287827200:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 2937us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134746.631649:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787134746.641419:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134746.641498:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287827456 00000100:00100000:1.0:1787134746.641508:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287827456 00000100:00100000:1.0:1787134746.641557:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:1.0:1787134746.641564:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+7:10242:x1873946287827456:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787134746.641585:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134746.641603:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906078 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702d3 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.641685:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.641698:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.641708:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.641760:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.641768:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.641974:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.643769:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae90608d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.643969:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae90608d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.643978:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae90608d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134746.643989:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787134746.644724:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644737:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644744:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644750:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deba00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134746.644755:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644763:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644776:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98aa44db2c00) 00010000:00010000:1.0:1787134746.644778:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134746.644847:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644854:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90607f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644869:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644875:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644881:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644886:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134746.644889:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644895:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644915:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98aa50adec00) 00010000:00010000:1.0:1787134746.644917:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134746.644920:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.644926:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906086 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.647509:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906078 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702d3 expref: 10 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.647540:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae90608d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702d3 expref: 9 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134746.647546:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:1.0:1787134746.647548:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134746.647551:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea600, rc 0) 00000100:00100000:1.0:1787134746.647623:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+9:10242:x1873946287827456:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 6058us (6213us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787134746.647629:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:3.0:1787134746.656992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134746.664018:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287827584 00000100:00100000:1.0:1787134746.664036:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287827584 00000100:00100000:0.0:1787134746.664602:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:0.0:1787134746.664631:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+9:10242:x1873946287827584:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787134746.664831:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+9:10242:x1873946287827584:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 Request processed in 203us (7851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134746.664839:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000040:00080000:0.0:1787134746.884080:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787134747.011408:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787134747.011431:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311985664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134747.011508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134747.011630:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311985664 00000100:00100000:1.0:1787134747.011639:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311985664 00000100:00100000:1.0:1787134747.011714:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787134747.011725:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa815bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311985664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134747.011764:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134747.011819:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa815bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311985664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134747.011828:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1787134747.011852:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa81020e00 x1873946311985664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134747.011872:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311985664:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787134747.012775:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787134747.072311:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134748.096291:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134748.134832:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134748.134932:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287827712 00000100:00100000:3.0:1787134748.134945:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287827712 00000100:00100000:3.0:1787134748.135018:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:3.0:1787134748.135029:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+9:10285:x1873946287827712:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787134748.135049:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134748.135068:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90609b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702da expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135133:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135148:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135179:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135196:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135203:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135209:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135496:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135504:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135512:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135519:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ac00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134748.135524:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135533:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135546:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50aded00) 00010000:00010000:3.0:1787134748.135549:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134748.135554:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135561:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135571:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135577:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135583:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135607:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134748.135611:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135618:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135626:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98aa42a7cd00) 00010000:00010000:3.0:1787134748.135628:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134748.135631:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135637:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135670:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90609b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702da expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135681:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50aded00) 00010000:00010000:3.0:1787134748.135683:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134748.135687:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90609b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702da expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.135696:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a200, rc 0) 00000100:00100000:3.0:1787134748.135758:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+9:10285:x1873946287827712:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 731us (938us total) trans 0 rc 301/301 00000100:00100000:3.0:1787134748.135766:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00080000:2.0:1787134748.136188:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134748.139834:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134748.140338:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287827968 00000100:00100000:3.0:1787134748.140359:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287827968 00000100:00100000:3.0:1787134748.140454:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:3.0:1787134748.140465:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+9:10285:x1873946287827968:12345-192.168.202.36@tcp:36:lfs.0 00010000:00010000:3.0:1787134748.140526:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134748.140558:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906055 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702c5 expref: 9 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.140576:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50aded00) 00010000:00010000:3.0:1787134748.140597:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787134748.140871:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.140898:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.142490:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.142512:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.142523:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.142529:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134748.144808:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787134748.144829:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.144839:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.144854:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.144860:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134748.144865:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.144875:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.144909:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7c000) 00010000:00010000:3.0:1787134748.144913:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134748.144918:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.144925:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787134748.144949:0:11683:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000001935cf82 reply state 00000000a8934b7a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134748.144960:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787134748.145423:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+10:10285:x1873946287827968:12345-192.168.202.36@tcp:36:lfs.0 Request processed in 4954us (5598us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787134748.145433:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00010000:00010000:1.0:1787134748.148255:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.148275:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.148283:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.148311:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134748.148317:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.148324:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.148346:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98aa42a7cb00) 00010000:00010000:1.0:1787134748.148349:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134748.148355:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.148361:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9060b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134748.237452:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134748.237628:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287828096 00000100:00100000:3.0:1787134748.237641:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287828096 00000100:00100000:3.0:1787134748.237713:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:1.0:1787134748.244130:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+9:10293:x1873946287828096:12345-192.168.202.36@tcp:101:lctl.0 00010000:00010000:1.0:1787134748.244177:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134748.244206:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9060be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702e1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.244282:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae9060c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.244296:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae9060c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.244307:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae9060c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134748.244658:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787134748.244664:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134748.244795:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae9060c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.244826:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9060be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702e1 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.244844:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae9060c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702e1 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.244853:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:1.0:1787134748.244855:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134748.244859:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59debc00, rc 0) 00000100:00100000:1.0:1787134748.245021:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+10:10293:x1873946287828096:12345-192.168.202.36@tcp:101:lctl.0 Request processed in 7294us (7574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134748.245031:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:3.0:1787134748.330983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134748.331053:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287828224 00000100:00100000:2.0:1787134748.331064:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287828224 00000100:00100000:0.0:1787134748.331504:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:3.0:1787134748.331544:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+10:10299:x1873946287828224:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787134748.331585:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134748.331607:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702e8 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.331686:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.331702:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.331715:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.331730:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.331736:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.331743:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.331902:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.331911:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.331917:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134748.331951:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787134748.331961:0:11472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787134748.332011:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332024:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332030:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332036:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332041:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134748.332046:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332053:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332079:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:3.0:1787134748.332083:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134748.332088:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332094:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9060d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332109:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332114:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332129:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332135:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134748.332139:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332145:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332152:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98aa42a7c000) 00010000:00010000:3.0:1787134748.332155:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134748.332502:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332511:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9060da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332553:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9060cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702e8 expref: 12 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332569:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702e8 expref: 11 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.332578:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:3.0:1787134748.332580:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787134748.332583:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7ac00, rc 0) 00000100:00100000:3.0:1787134748.332785:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+11:10299:x1873946287828224:12345-192.168.202.36@tcp:101:bash.0 Request processed in 1270us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134748.332805:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:3.0:1787134748.337264:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134748.337778:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287828480 00000100:00100000:0.0:1787134748.337789:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287828480 00000100:00100000:0.0:1787134748.338255:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:0.0:1787134748.338267:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+11:10299:x1873946287828480:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787134748.338301:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134748.338324:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9060e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702ef expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.338484:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.338501:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.338531:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.338575:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.338583:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.338591:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787134748.339975:0:11683:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787134748.340200:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.340213:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.340221:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.340257:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.340264:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.340271:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.340277:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134748.341243:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.341257:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.341270:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:0.0:1787134748.341273:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134748.341277:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.341283:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9060ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787134748.341307:0:11683:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000a92cf6a3 reply state 000000005ec8c1da transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134748.341316:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787134748.341358:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9060e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702ef expref: 14 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.341372:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702ef expref: 13 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.341379:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134748.341381:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134748.341383:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451400, rc 0) 00000100:00100000:0.0:1787134748.341545:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+14:10299:x1873946287828480:12345-192.168.202.36@tcp:101:bash.0 Request processed in 3280us (4486us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787134748.341554:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 40 00010000:00010000:2.0:1787134748.344813:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.344829:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.344861:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.344867:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134748.344872:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.344881:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.344907:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa44db2500) 00010000:00010000:2.0:1787134748.344910:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134748.344915:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.344920:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9060f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134748.351250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.351337:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287828608 00000100:00100000:1.0:1787134748.351347:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287828608 00000100:00100000:1.0:1787134748.351391:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:1.0:1787134748.351399:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1873946287828608:12345-192.168.202.36@tcp:8:bash.0 00010000:00080000:1.0:1787134748.351429:0:6682:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from 486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:1.0:1787134748.351460:0:6682:0:(genops.c:1406:class_connect()) connect: client 486fb1ad-4266-4864-b299-111c5140734b, cookie 0x69932dacae90610b 00002000:00100000:1.0:1787134748.351473:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 486fb1ad-4266-4864-b299-111c5140734b/ffff98aa7ae03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787134748.351497:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:1.0:1787134748.351718:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787134748.351748:0:6682:0:(import.c:65:import_set_state_nolock()) ffff98aa7ae05800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787134748.351813:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2348:x1873946287828608:12345-192.168.202.36@tcp:8:bash.0 Request processed in 414us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134748.351821:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:0.0:1787134748.355266:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.355362:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287828736 00000100:00100000:1.0:1787134748.355373:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287828736 00000100:00100000:1.0:1787134748.355439:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:1.0:1787134748.355450:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:0:x1873946287828736:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134748.355476:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134748.355500:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702f6 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787134748.355526:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787134748.355545:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1787134748.355549:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134748.355560:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702f6 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.355585:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702f6 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.355599:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea000, rc 0) 00000100:00100000:1.0:1787134748.355667:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:0:x1873946287828736:12345-192.168.202.36@tcp:101:bash.0 Request processed in 219us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134748.355676:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00080000:2.0:1787134748.356632:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134748.359449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.359559:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287828864 00000100:00100000:1.0:1787134748.359584:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287828864 00000100:00100000:1.0:1787134748.359644:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:1.0:1787134748.359654:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:10299:x1873946287828864:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134748.359674:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134748.359693:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90702fd expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.359727:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702f6 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.359736:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134748.359741:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134748.359746:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.359795:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702f6 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.359810:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702f6 expref: 8 pid: 6681 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134748.359824:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1873946311985792:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134748.360475:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd78900 going to sleep for 11 seconds 00000100:00100000:0.0:1787134748.366243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134748.366349:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287828992 00000100:00100000:2.0:1787134748.366359:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287828992 00010000:00010000:2.0:1787134748.366408:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702f6 expref: 9 pid: 6681 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134748.366453:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:2.0:1787134748.366464:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287828992:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134748.366491:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134748.366515:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702f6 expref: 9 pid: 6681 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.366544:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702f6 expref: 9 pid: 6681 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.366576:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134748.366594:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134748.366604:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.366615:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.366655:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134748.366671:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1873946311985920:192.168.202.36@tcp:105: 00000100:00100000:2.0:1787134748.366758:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50886c00 going to sleep for 11 seconds 00010000:00010000:1.0:1787134748.367129:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906112 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702f6 expref: 9 pid: 6681 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134748.367198:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1873946311985792:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134748.367225:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.367243:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb400, rc 0) 00000100:00100000:1.0:1787134748.367280:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+8:10299:x1873946287828864:12345-192.168.202.36@tcp:101:bash.0 Request processed in 7626us (7842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134748.367289:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:2.0:1787134748.370151:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1873946311985920:192.168.202.36@tcp:105: 00010000:00010000:2.0:1787134748.370219:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134748.370272:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+7:2352:x1873946287828992:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 3809us (4041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134748.370285:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:0.0:1787134748.371642:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.371712:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287829248 00000100:00100000:1.0:1787134748.371720:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287829248 00000100:00100000:1.0:1787134748.371772:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:1.0:1787134748.371782:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+13:10299:x1873946287829248:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:1.0:1787134748.372224:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+14:10299:x1873946287829248:12345-192.168.202.36@tcp:35:bash.0 Request processed in 442us (587us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787134748.372233:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:0.0:1787134748.434100:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.434210:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287829504 00000100:00100000:1.0:1787134748.434220:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287829504 00000100:00100000:1.0:1787134748.434297:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:1.0:1787134748.434309:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+14:10309:x1873946287829504:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134748.434335:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134748.434356:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070304 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134748.434482:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787134748.434629:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906120 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070304 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.434645:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:1.0:1787134748.434649:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134748.434654:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070304 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.434669:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea000, rc 0) 00000100:00100000:1.0:1787134748.434787:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+15:10309:x1873946287829504:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 479us (696us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787134748.434795:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:3.0:1787134748.438659:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.438746:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287829760 00000100:00100000:1.0:1787134748.438757:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287829760 00000100:00100000:1.0:1787134748.438824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:1.0:1787134748.438845:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+15:10309:x1873946287829760:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787134748.439146:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+16:10309:x1873946287829760:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 311us (497us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787134748.439154:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:0.0:1787134748.495592:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134748.495676:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287829888 00000100:00100000:3.0:1787134748.495689:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287829888 00000100:00100000:3.0:1787134748.495751:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:3.0:1787134748.495762:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+16:10315:x1873946287829888:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787134748.495796:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134748.495818:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae90612e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907030b expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.495909:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae906135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.495924:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae906135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.495937:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae906135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134748.495998:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787134748.496002:0:11472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787134748.496029:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae906135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.496060:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae90612e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907030b expref: 18 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.496100:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae906135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907030b expref: 17 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.496109:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:3.0:1787134748.496113:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787134748.496116:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a400, rc 0) 00000100:00100000:3.0:1787134748.496247:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+17:10315:x1873946287829888:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 486us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134748.496255:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:3.0:1787134748.500994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134748.501084:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287830144 00000100:00100000:0.0:1787134748.501093:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287830144 00000100:00100000:0.0:1787134748.501147:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:0.0:1787134748.501188:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+17:10315:x1873946287830144:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134748.501209:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134748.501231:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90613c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070312 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.501346:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906143 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.501360:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.501371:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134748.501383:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787134748.501514:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90613c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070312 expref: 20 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.501532:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070312 expref: 19 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.501559:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134748.501562:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134748.501566:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450400, rc 0) 00000100:00100000:0.0:1787134748.501631:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+19:10315:x1873946287830144:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 474us (645us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787134748.501639:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:2.0:1787134748.505324:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134748.505411:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287830400 00000100:00100000:0.0:1787134748.505422:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287830400 00000100:00100000:0.0:1787134748.505483:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:0.0:1787134748.505494:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+19:10315:x1873946287830400:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134748.505519:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134748.505538:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906151 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070319 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.505631:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906158 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.505646:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906158 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.505658:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906158 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134748.505670:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787134748.505809:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906151 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070319 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.505858:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906158 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070319 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.505867:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134748.505871:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787134748.505875:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450e00, rc 0) 00000100:00100000:0.0:1787134748.505946:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+21:10315:x1873946287830400:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 453us (631us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787134748.505954:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:3.0:1787134748.513018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134748.513203:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287830528 00000100:00100000:2.0:1787134748.513214:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287830528 00000100:00100000:2.0:1787134748.513296:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:2.0:1787134748.513306:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+21:2349:x1873946287830528:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134748.513321:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134748.513347:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906143 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070312 expref: 21 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.513366:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134748.513371:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134748.513429:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+20:2349:x1873946287830528:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 125us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134748.513437:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:2.0:1787134748.516866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.517020:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287830656 00000100:00100000:1.0:1787134748.517031:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287830656 00000100:00100000:1.0:1787134748.517097:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:1.0:1787134748.517107:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287830656:12345-192.168.202.36@tcp:1:lfs.0 00010000:00010000:1.0:1787134748.518115:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.518143:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.518282:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134748.518288:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134748.518293:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.518341:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.518357:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 7 pid: 6682 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134748.518373:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1873946311986048:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134748.518468:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd78840 going to sleep for 11 seconds 00000100:00100000:1.0:1787134748.521019:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1873946311986048:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134748.521056:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134748.521794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.521901:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287830784 00000100:00100000:1.0:1787134748.521910:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287830784 00002000:00100000:1.0:1787134748.521958:0:6686:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98aa819e7480 x1873946287830784/t0(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:684/0 lens 504/0 e 0 to 0 dl 1787134759 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787134748.521969:0:6686:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa819e7480 with x1873946287830784 ext(0->12) 00010000:00010000:1.0:1787134748.521978:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 8 pid: 6682 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.522013:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 8 pid: 6682 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787134748.522021:0:6686:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98aa819e7480 00000100:00100000:1.0:1787134748.522063:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787134748.522074:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287830784:12345-192.168.202.36@tcp:4:lfs.0 00000100:00100000:3.0:1787134748.544554:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311986304:0@lo:400:kworker.0 00000100:00100000:3.0:1787134748.544632:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134748.544663:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311986816:0@lo:400:kworker.0 00000100:00100000:3.0:1787134748.544690:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134748.544715:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787134748.544721:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311986432:0@lo:400:kworker.0 00000100:00100000:3.0:1787134748.544746:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134748.544865:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311986560:0@lo:400:kworker.0 00000100:00100000:2.0:1787134748.544904:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134748.544926:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787134748.544933:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311986176:0@lo:400:kworker.0 00000100:00100000:2.0:1787134748.544958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134748.544981:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1873946311986688:0@lo:400:kworker.0 00000100:00100000:2.0:1787134748.545000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134748.545028:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311986816 00000100:00100000:2.0:1787134748.545035:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311986816 00000100:00100000:2.0:1787134748.545076:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311986560 00000100:00100000:2.0:1787134748.545079:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311986560 00000100:00100000:2.0:1787134748.545093:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787134748.545100:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311986816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134748.545183:0:7839:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787134748.545191:0:7839:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787134748.545321:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311986304 00000100:00100000:0.0:1787134748.545325:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311986304 00000100:00100000:0.0:1787134748.545357:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311986432 00000100:00100000:0.0:1787134748.545360:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311986432 00000100:00100000:0.0:1787134748.545378:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311986688 00000100:00100000:0.0:1787134748.545381:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311986688 00000100:00100000:0.0:1787134748.545394:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787134748.545400:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311986304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134748.545534:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787134748.545543:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311986432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134748.545620:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311986816:12345-0@lo:400:kworker.0 Request processed in 519us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134748.545637:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787134748.546183:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311986176 00000100:00100000:2.0:1787134748.546189:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311986176 00000100:00100000:2.0:1787134748.546220:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787134748.546227:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311986176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134748.546283:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311986176:12345-0@lo:400:kworker.0 Request processed in 55us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134748.546290:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787134748.546321:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787134748.546329:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873946311986688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134748.546359:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873946311986688:12345-0@lo:400:kworker.0 Request processed in 32us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134748.546366:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1787134748.546383:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787134748.546388:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787134748.546405:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787134748.546412:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311986560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134748.546442:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311986560:12345-0@lo:400:kworker.0 Request processed in 31us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134748.546448:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787134748.546477:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311986176:0@lo:400:kworker.0 00000100:00100000:2.0:1787134748.546490:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1873946311986688:0@lo:400:kworker.0 00000100:00100000:2.0:1787134748.546499:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311986560:0@lo:400:kworker.0 00000100:00100000:0.0:1787134748.548214:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311986304:12345-0@lo:400:kworker.0 Request processed in 2807us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134748.548226:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787134748.549198:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311986432:12345-0@lo:400:kworker.0 Request processed in 3651us (4446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134748.549208:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787134748.551590:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311986432:0@lo:400:kworker.0 00000100:00100000:1.0:1787134748.551610:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311986304:0@lo:400:kworker.0 00000100:00100000:1.0:1787134748.551622:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311986816:0@lo:400:kworker.0 00000001:00100000:2.0:1787134748.552393:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000100:00100000:1.0:1787134748.553270:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486fb1ad-4266-4864-b299-111c5140734b+9:2351:x1873946287830784:12345-192.168.202.36@tcp:4:lfs.0 Request processed in 31191us (31474us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787134748.553282:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00002000:00100000:1.0:1787134748.553294:0:6686:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98aa819e7480 x1873946287830784/t4294967299(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:684/0 lens 504/448 e 0 to 0 dl 1787134759 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787134748.553304:0:6686:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa819e7480 with x1873946287830784 ext(0->12) 00010000:00010000:1.0:1787134748.553314:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 9 pid: 6682 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.553329:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 9 pid: 6682 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787134748.553336:0:6686:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98aa819e7480 00000100:00100000:3.0:1787134748.555622:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134748.555730:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287830912 00000100:00100000:0.0:1787134748.555743:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287830912 00010000:00010000:0.0:1787134748.555793:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 9 pid: 6682 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134748.555910:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:0.0:1787134748.555921:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287830912:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134748.555949:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787134748.555970:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787134748.555974:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787134748 00002000:00010000:0.0:1787134748.555976:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787134749 00002000:00010000:0.0:1787134748.555978:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787134748 00010000:00010000:0.0:1787134748.555995:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 9 pid: 6682 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.556010:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 9 pid: 6682 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.556036:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906119 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702fd expref: 9 pid: 6682 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.556054:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787134748.556059:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787134748.556064:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.556075:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.556111:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134748.556184:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134748.556184:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+8:2352:x1873946287830912:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 264us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134748.556192:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00010000:00010000:1.0:1787134748.556194:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.556217:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.556226:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.556233:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.556240:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134748.556244:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.556253:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.556265:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.556272:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906166 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134748.556328:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287830656:12345-192.168.202.36@tcp:1:lfs.0 Request processed in 39222us (39471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134748.556336:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:3.0:1787134748.558231:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.558275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287831168 00000100:00100000:1.0:1787134748.558284:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287831168 00000100:00100000:1.0:1787134748.558338:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:1.0:1787134748.558348:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+20:10315:x1873946287831168:12345-192.168.202.36@tcp:35:lfs.0 00000004:00010000:1.0:1787134748.558408:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906158 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070319 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787134748.558677:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787134748.559791:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787134748.560422:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787134748.560485:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.560504:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702ef expref: 24 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.560514:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.560549:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702ef expref: 24 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.560565:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702ef expref: 24 pid: 11683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134748.560592:0:5839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1873946311986944:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134748.560675:0:5839:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa44fbef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787134748.563115:0:5839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1873946311986944:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134748.563143:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134748.563686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134748.563731:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287831296 00000100:00100000:2.0:1787134748.563738:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287831296 00010000:00010000:2.0:1787134748.563778:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702ef expref: 25 pid: 11683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134748.563821:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:2.0:1787134748.563831:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+25:2352:x1873946287831296:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134748.563845:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134748.563852:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702ef expref: 25 pid: 11683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.563865:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702ef expref: 25 pid: 11683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.563898:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9060fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90702ef expref: 25 pid: 11683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.563916:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134748.563921:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.563930:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.563938:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.563966:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134748.563985:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.563993:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134748.564015:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+24:2352:x1873946287831296:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 185us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134748.564035:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00000001:00080000:1.0:1787134748.564113:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787134748.565524:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787134748.565636:0:5839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1873946311987072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787134748.565687:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134748.565718:0:5839:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81abba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787134748.565816:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311987072 00000100:00100000:3.0:1787134748.565822:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311987072 00000100:00100000:3.0:1787134748.565869:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787134748.565877:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1873946311987072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787134748.565963:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1873946311987072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134748.565972:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134748.567962:0:5839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1873946311987072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787134748.568951:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787134748.569030:0:5839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1873946311987200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787134748.569086:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134748.569199:0:5839:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50886d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787134748.569358:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311987200 00000100:00100000:3.0:1787134748.569365:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311987200 00000100:00100000:3.0:1787134748.569440:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134748.569449:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1873946311987200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787134748.569621:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1873946311987200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 173us (533us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787134748.569629:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787134748.569686:0:5839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1873946311987200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787134748.569736:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787134748.569772:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.569783:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.569790:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.569796:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deba00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134748.569801:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.569809:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.569825:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134748.569828:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787134748.569845:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.569864:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90616d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787134748.570030:0:5839:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787134748.570299:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787134748.570311:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364537152137ns, next at 365537150104ns, rc = 0 00000001:00080000:2.0:1787134748.570318:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787134748.570350:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134748.570354:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787134748.570361:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906158 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070319 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134748.570458:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+27:10315:x1873946287831168:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 12112us (12234us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787134748.570467:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000020:00080000:2.0:1787134748.570470:0:5839:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787134748.572789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134748.572892:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287831424 00000100:00100000:2.0:1787134748.572901:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287831424 00000100:00100000:2.0:1787134748.572994:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:2.0:1787134748.573004:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+27:10315:x1873946287831424:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134748.573028:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134748.573049:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906174 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070320 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.573110:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070320 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.573143:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070320 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.573207:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134748.573211:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134748.573215:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97400, rc 0) 00000100:00100000:2.0:1787134748.573437:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+28:10315:x1873946287831424:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 434us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134748.573445:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:0.0:1787134748.575586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134748.575667:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287831680 00000100:00100000:3.0:1787134748.575677:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287831680 00000100:00100000:3.0:1787134748.575723:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:3.0:1787134748.575732:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa50e40c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+28:10315:x1873946287831680:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787134748.576029:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa50e40c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+29:10315:x1873946287831680:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 297us (450us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787134748.576037:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:3.0:1787134748.652234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134748.652476:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287831936 00000100:00100000:0.0:1787134748.652485:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287831936 00000100:00100000:0.0:1787134748.652552:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:0.0:1787134748.652562:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+29:10325:x1873946287831936:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134748.652590:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134748.652612:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90617b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070327 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134748.652731:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787134748.652894:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90617b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070327 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.652911:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:0.0:1787134748.652914:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787134748.652920:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90617b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070327 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.652936:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450600, rc 0) 00000100:00100000:0.0:1787134748.653008:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+30:10325:x1873946287831936:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 447us (784us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787134748.653017:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:0.0:1787134748.658139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134748.658412:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287832064 00000100:00100000:3.0:1787134748.658424:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287832064 00000100:00100000:3.0:1787134748.658507:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:3.0:1787134748.658519:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+30:10325:x1873946287832064:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:3.0:1787134748.658606:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.658626:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.658638:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.658654:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.658662:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.658669:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.658945:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.658954:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.658961:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787134748.659008:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659023:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659037:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659043:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659050:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134748.659055:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659063:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659077:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:3.0:1787134748.659080:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134748.659085:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659091:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906189 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659106:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659112:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659118:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659123:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134748.659132:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659139:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659147:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa42a7c900) 00010000:00010000:3.0:1787134748.659150:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134748.659153:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659367:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659387:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659393:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659400:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659405:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ae00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134748.659409:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659416:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659424:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:3.0:1787134748.659427:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134748.659436:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.659442:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906197 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134748.659540:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+30:10325:x1873946287832064:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1021us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134748.659549:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:3.0:1787134748.662662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.662755:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287832320 00000100:00100000:1.0:1787134748.662778:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287832320 00000100:00100000:1.0:1787134748.662846:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787134748.662858:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+30:10325:x1873946287832320:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787134748.663150:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+31:10325:x1873946287832320:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 294us (498us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787134748.663188:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787134748.691703:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134748.691985:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287832576 00000100:00100000:2.0:1787134748.691997:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287832576 00000100:00100000:2.0:1787134748.692063:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:2.0:1787134748.692075:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+31:10328:x1873946287832576:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134748.692105:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134748.692128:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae90619e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907032e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692269:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692286:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692298:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692313:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692336:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692343:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692476:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692486:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692492:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134748.692502:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787134748.692599:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692607:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692613:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692619:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134748.692624:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692631:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692654:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134748.692657:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134748.692662:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692668:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692682:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692688:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692694:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692699:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134748.692702:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692708:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692714:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa59e99b00) 00010000:00010000:2.0:1787134748.692716:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134748.692719:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692724:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692791:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae90619e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907032e expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692806:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907032e expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.692813:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134748.692816:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134748.692818:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97e00, rc 0) 00000100:00100000:2.0:1787134748.693235:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+33:10328:x1873946287832576:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1160us (1540us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787134748.693243:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:3.0:1787134748.696890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.696957:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287832704 00000100:00100000:1.0:1787134748.696967:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287832704 00000100:00100000:1.0:1787134748.697044:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:1.0:1787134748.697054:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+33:10328:x1873946287832704:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:1.0:1787134748.697117:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.697133:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.697144:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.697194:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.697202:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.697209:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.697215:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134748.697219:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.697228:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.697239:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134748.697243:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134748.697247:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.697514:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134748.697786:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+33:10328:x1873946287832704:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 731us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134748.697795:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:3.0:1787134748.700106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.700215:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287832960 00000100:00100000:1.0:1787134748.700224:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287832960 00000100:00100000:1.0:1787134748.700287:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787134748.700297:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+33:10328:x1873946287832960:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787134748.700530:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+34:10328:x1873946287832960:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 234us (432us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787134748.700537:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:0.0:1787134748.922456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134748.922593:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287833216 00000100:00100000:3.0:1787134748.922604:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287833216 00000100:00100000:3.0:1787134748.922661:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:3.0:1787134748.922670:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+34:10359:x1873946287833216:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:3.0:1787134748.922696:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134748.922718:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9061c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070335 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.923227:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9061cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.923246:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9061cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.923258:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9061cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134748.923281:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787134748.923465:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9061c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070335 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.923484:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9061cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070335 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.923493:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:3.0:1787134748.923496:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787134748.923500:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b800, rc 0) 00000100:00100000:3.0:1787134748.923569:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+36:10359:x1873946287833216:12345-192.168.202.36@tcp:101:cat.0 Request processed in 900us (1123us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787134748.923577:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:2.0:1787134748.928631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134748.928679:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.928743:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287833472 00000100:00100000:1.0:1787134748.928754:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287833472 00000100:00100000:1.0:1787134748.928832:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787134748.928845:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+36:10359:x1873946287833472:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:1.0:1787134748.929232:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+37:10359:x1873946287833472:12345-192.168.202.36@tcp:35:cat.0 Request processed in 388us (609us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787134748.929240:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:0.0:1787134748.929473:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287833600 00000100:00100000:0.0:1787134748.929479:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287833600 00000100:00100000:0.0:1787134748.929546:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:0.0:1787134748.929554:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+37:2352:x1873946287833600:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134748.929565:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134748.929591:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9061cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070335 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134748.929609:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:0.0:1787134748.929614:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134748.929635:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+36:2352:x1873946287833600:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 83us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134748.929641:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:0.0:1787134748.976436:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134748.976542:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287833856 00000100:00100000:2.0:1787134748.976554:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287833856 00000100:00100000:2.0:1787134748.976623:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:2.0:1787134748.976634:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+36:10365:x1873946287833856:12345-192.168.202.36@tcp:101:dd.0 00010000:00010000:2.0:1787134748.976664:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134748.976667:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787134748.976703:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae906135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907030b expref: 36 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.976726:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134748.976731:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134748.976746:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907033c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.976886:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.976902:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907032e expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.976912:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.976951:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907032e expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134748.976966:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907032e expref: 36 pid: 5837 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134748.976982:0:5837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1873946311987328:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134748.977104:0:5837:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54b7fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787134748.983542:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.983655:0:5837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1873946311987328:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134748.983692:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134748.983810:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287833984 00000100:00100000:3.0:1787134748.983818:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287833984 00010000:00010000:3.0:1787134748.983867:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907032e expref: 37 pid: 5837 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134748.983923:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:3.0:1787134748.983934:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+37:2351:x1873946287833984:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134748.983952:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134748.983960:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907032e expref: 37 pid: 5837 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.983973:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907032e expref: 37 pid: 5837 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.984002:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9061b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907032e expref: 37 pid: 5837 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.984046:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:3.0:1787134748.984052:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.984061:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.984069:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134748.984101:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134748.984210:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+36:2351:x1873946287833984:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 277us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134748.984218:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00010000:00010000:1.0:1787134748.984307:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.984321:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134748.984346:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787134748.984526:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9061dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907033c expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.984543:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907033c expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.984552:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134748.984555:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787134748.984557:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96c00, rc 0) 00000100:00100000:1.0:1787134748.984587:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+36:10365:x1873946287833856:12345-192.168.202.36@tcp:101:dd.0 Request processed in 7956us (8163us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787134748.984595:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:3.0:1787134748.988292:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134748.988409:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287834240 00000100:00100000:1.0:1787134748.988422:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287834240 00000100:00100000:1.0:1787134748.988475:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:1.0:1787134748.988484:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+36:10365:x1873946287834240:12345-192.168.202.36@tcp:36:dd.0 00010000:00010000:1.0:1787134748.988803:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.988823:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.988844:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787134748.988930:0:11683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787134748.988953:0:11683:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000007daa4cdd reply state 000000001d7f0887 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134748.988963:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787134748.989070:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+39:10365:x1873946287834240:12345-192.168.202.36@tcp:36:dd.0 Request processed in 586us (790us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787134748.989077:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00000020:00080000:1.0:1787134748.989082:0:11683:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787134748.990723:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.990738:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.990746:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.990752:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134748.990757:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.990775:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.990791:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134748.990794:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134748.990800:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134748.990806:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9061f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134749.056601:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787134749.056623:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311987456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134749.056689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134749.056732:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311987456 00000100:00100000:1.0:1787134749.056739:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311987456 00000100:00100000:1.0:1787134749.056791:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787134749.056799:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311987456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134749.056840:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134749.056904:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311987456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134749.056912:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787134749.056955:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311987456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787134749.120812:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134749.186770:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134749.186889:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287834368 00000100:00100000:0.0:1787134749.186900:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287834368 00000100:00100000:0.0:1787134749.187009:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:0.0:1787134749.187020:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+38:10379:x1873946287834368:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:0.0:1787134749.187046:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134749.187067:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae9061f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070343 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187138:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187152:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187193:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187228:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187236:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187243:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187356:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187367:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907033c expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187376:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187412:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907033c expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.187426:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907033c expref: 39 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134749.187439:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa52a70700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311987584:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134749.187537:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa814290c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134749.194220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134749.194309:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287834624 00000100:00100000:1.0:1787134749.194320:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287834624 00000100:00100000:1.0:1787134749.194379:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:1.0:1787134749.194390:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+40:5590:x1873946287834624:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787134749.194778:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+41:5590:x1873946287834624:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 389us (566us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787134749.194787:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787134749.195567:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa52a70700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311987584:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134749.195595:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134749.197703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134749.197936:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287834752 00000100:00100000:0.0:1787134749.197947:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287834752 00010000:00010000:0.0:1787134749.197998:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907033c expref: 41 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134749.198041:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:0.0:1787134749.198052:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+41:2351:x1873946287834752:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134749.198070:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134749.198078:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907033c expref: 41 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.198091:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907033c expref: 41 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.198116:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9061e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907033c expref: 41 pid: 5837 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.198137:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:0.0:1787134749.198143:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.198154:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.198217:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.198256:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134749.198333:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+40:2351:x1873946287834752:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 282us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134749.198341:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00010000:00010000:1.0:1787134749.198987:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.198997:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134749.199048:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787134749.199061:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134749.199106:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199120:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199130:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199136:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199143:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199149:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134749.199153:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199202:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199213:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134749.199216:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134749.199219:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199225:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906200 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199237:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199254:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199270:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199276:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134749.199279:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199285:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199294:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa44db2000) 00010000:00010000:1.0:1787134749.199296:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134749.199300:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199306:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199345:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae9061f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070343 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199357:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070343 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.199364:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134749.199366:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134749.199373:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451200, rc 0) 00000100:00100000:1.0:1787134749.199410:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+39:10379:x1873946287834368:12345-192.168.202.36@tcp:101:stat.0 Request processed in 12393us (12650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134749.199417:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:3.0:1787134749.298788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134749.298964:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287835008 00000100:00100000:1.0:1787134749.298977:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287835008 00000100:00100000:1.0:1787134749.299052:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:1.0:1787134749.299064:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+39:10385:x1873946287835008:12345-192.168.202.36@tcp:36:truncate.0 00010000:00010000:1.0:1787134749.299132:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134749.299191:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90620e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070343 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.299214:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134749.299221:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134749.299479:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.299495:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.299506:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787134749.299562:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787134749.299585:0:5837:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000f1dde29c reply state 000000007d4bf047 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134749.299594:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787134749.299738:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+41:10385:x1873946287835008:12345-192.168.202.36@tcp:36:truncate.0 Request processed in 675us (958us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787134749.299766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 54 00000020:00080000:1.0:1787134749.299773:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787134749.302506:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.302524:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.302531:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.302537:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134749.302541:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.302548:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.302564:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:0.0:1787134749.302567:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134749.302572:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.302577:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906215 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134749.435323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134749.435392:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134749.435438:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134749.435627:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287835136 00000100:00100000:1.0:1787134749.435641:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287835136 00000100:00100000:2.0:1787134749.435650:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287835264 00000100:00100000:2.0:1787134749.435655:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287835264 00000100:00100000:1.0:1787134749.435706:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 292 00000100:00100000:2.0:1787134749.435712:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:2.0:1787134749.435720:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+7:2349:x1873946287835264:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134749.435720:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287835136:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134749.435835:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287835392 00000100:00100000:0.0:1787134749.435840:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287835392 00000100:00080000:3.0:1787134749.435899:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134749.435901:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 152 00000100:00100000:0.0:1787134749.435909:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287835392:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134749.442728:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+7:2349:x1873946287835264:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 6995us (7408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134749.442749:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:1.0:1787134749.450144:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287835136:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 14415us (14739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134749.450184:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 292 00000100:00100000:0.0:1787134749.450369:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287835392:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 14459us (14929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134749.450380:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 152 00000100:00100000:3.0:1787134749.495372:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134749.495576:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287835520 00000100:00100000:1.0:1787134749.495588:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287835520 00000100:00100000:1.0:1787134749.495655:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:1.0:1787134749.495667:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+40:10399:x1873946287835520:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:1.0:1787134749.495699:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134749.495726:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae90621c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907034a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.495819:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.495851:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.495865:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.495894:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.495917:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.495926:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496037:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496046:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496054:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134749.496091:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787134749.496096:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134749.496118:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496129:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496139:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496146:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496153:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496217:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deac00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134749.496222:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496231:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496246:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134749.496250:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134749.496255:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496276:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496302:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496309:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496316:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496321:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134749.496324:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496331:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496352:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa50ade700) 00010000:00010000:1.0:1787134749.496354:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134749.496358:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496365:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae90622a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496400:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae90621c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907034a expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496414:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907034a expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.496423:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134749.496425:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134749.496428:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deba00, rc 0) 00000100:00100000:1.0:1787134749.496716:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+41:10399:x1873946287835520:12345-192.168.202.36@tcp:101:stat.0 Request processed in 1050us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134749.496724:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:2.0:1787134749.594340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134749.594384:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287835776 00000100:00100000:2.0:1787134749.594394:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287835776 00000100:00100000:2.0:1787134749.594451:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:2.0:1787134749.594462:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+41:10409:x1873946287835776:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134749.594485:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134749.594508:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070351 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134749.594757:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787134749.595006:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906238 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070351 expref: 43 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.595020:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:2.0:1787134749.595023:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134749.595027:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070351 expref: 43 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.595036:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96800, rc 0) 00000100:00100000:2.0:1787134749.595092:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+42:10409:x1873946287835776:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 633us (763us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787134749.595100:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:2.0:1787134749.605983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134749.608680:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287836032 00000100:00100000:0.0:1787134749.608694:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287836032 00000100:00100000:0.0:1787134749.608745:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787134749.608754:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+42:10409:x1873946287836032:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134749.609209:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+43:10409:x1873946287836032:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 455us (3236us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787134749.609218:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000001:00080000:3.0:1787134749.655918:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967327 is committed 00000001:00080000:3.0:1787134749.655951:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:3.0:1787134749.656020:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787134749.656047:0:5858:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98aa50886000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787134749.656070:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa818de900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98aa50886c00 00000020:00080000:3.0:1787134749.656074:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa818de400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98aa7bd40800 00000020:00080000:2.0:1787134749.656199:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787134749.656329:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787134749.656676:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa52a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311987712:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787134749.656751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134749.656903:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311987712 00000100:00100000:0.0:1787134749.656911:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311987712 00000100:00100000:0.0:1787134749.656981:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787134749.656987:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134749.656993:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946311987712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787134749.657024:0:7839:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787134749.657058:0:7839:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a85831c, atime: 0x6a85831d, ctime: 0x6a85831c, blocks: 0x1 00010000:00010000:0.0:1787134749.657066:0:7839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.657082:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1787134749.657087:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134749.657094:0:7839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.657110:0:7839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.657131:0:7839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.657138:0:7839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.657284:0:7839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134749.657299:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134749.657308:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.657318:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450c00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134749.657323:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.657334:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.657356:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.657363:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae039a6/0x69932dacae906246 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.657382:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134749.657384:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134749.657385:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134749.657816:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946311987712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 824us (1063us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787134749.657825:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1787134749.657939:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa52a70700/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787134749.657947:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa52a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311987712:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787134749.672091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134749.675061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287836288 00000100:00100000:2.0:1787134749.675079:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287836288 00000100:00100000:2.0:1787134749.675220:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:2.0:1787134749.675234:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+13:10415:x1873946287836288:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134749.675265:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134749.675288:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90624d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070358 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.675406:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.675422:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907034a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.675432:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.675466:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907034a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.675480:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907034a expref: 14 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134749.675495:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946311987840:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134749.675611:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4300e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134749.685208:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134749.685360:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287836416 00000100:00100000:3.0:1787134749.685369:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287836416 00010000:00010000:3.0:1787134749.685410:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907034a expref: 15 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134749.685503:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:3.0:1787134749.685511:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81023b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+15:2352:x1873946287836416:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134749.685524:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134749.685530:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907034a expref: 15 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.685541:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907034a expref: 15 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134749.685558:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946311987840:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134749.685565:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907034a expref: 15 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.685587:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134749.685588:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.685596:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.685609:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.685618:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.687900:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134749.687971:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.687983:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134749.687990:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81023b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+14:2352:x1873946287836416:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 2474us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134749.688004:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 40 00000004:00200000:1.0:1787134749.688021:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787134749.688342:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90624d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070358 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.688366:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070358 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.688374:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134749.688377:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787134749.688380:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97000, rc 0) 00000100:00100000:1.0:1787134749.688407:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+14:10415:x1873946287836288:12345-192.168.202.36@tcp:101:bash.0 Request processed in 13178us (16326us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787134749.688415:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:3.0:1787134749.690775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134749.690888:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287836672 00000100:00100000:0.0:1787134749.690900:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287836672 00000100:00100000:0.0:1787134749.691020:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:0.0:1787134749.691032:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+14:10415:x1873946287836672:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:0.0:1787134749.691370:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.691387:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.691400:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787134749.691450:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787134749.691477:0:5836:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000837ff6b8 reply state 00000000502dd230 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134749.691499:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787134749.691591:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+17:10415:x1873946287836672:12345-192.168.202.36@tcp:36:bash.0 Request processed in 561us (823us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787134749.691599:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00000020:00080000:0.0:1787134749.691604:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787134749.695120:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.695137:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.695145:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.695152:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134749.695182:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.695192:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.695229:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134749.695232:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134749.695238:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.695245:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906262 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134749.695999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134749.696068:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287836800 00000100:00100000:2.0:1787134749.696079:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287836800 00000100:00100000:2.0:1787134749.696139:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:2.0:1787134749.696150:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+16:10415:x1873946287836800:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134749.696215:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134749.696234:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906269 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907035f expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.696332:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.696347:0:11472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070358 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.696356:0:11472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.696387:0:11472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070358 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134749.696401:0:11472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070358 expref: 17 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134749.696415:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311987968:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134749.696492:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4300e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134749.699630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134749.699733:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311987968:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134749.699762:0:11472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134749.699829:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287836928 00000100:00100000:0.0:1787134749.699837:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287836928 00010000:00010000:0.0:1787134749.699887:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070358 expref: 18 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134749.699925:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:0.0:1787134749.699937:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+18:2351:x1873946287836928:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134749.699952:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134749.699959:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070358 expref: 18 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.699972:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070358 expref: 18 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.699997:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906254 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070358 expref: 18 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.700013:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:0.0:1787134749.700018:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.700029:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.700052:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.700080:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787134749.700121:0:11472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.700129:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134749.700139:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+17:2351:x1873946287836928:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 204us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134749.700148:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00000004:00200000:3.0:1787134749.700202:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787134749.700208:0:11472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787134749.700230:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.700272:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906269 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907035f expref: 17 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.700291:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907035f expref: 16 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134749.700299:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:3.0:1787134749.700302:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787134749.700304:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96c00, rc 0) 00000100:00100000:3.0:1787134749.700334:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+16:10415:x1873946287836800:12345-192.168.202.36@tcp:101:bash.0 Request processed in 4185us (4339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134749.700342:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:3.0:1787134749.703078:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134749.703205:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287837184 00000100:00100000:1.0:1787134749.703216:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287837184 00000100:00100000:1.0:1787134749.703278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:1.0:1787134749.703290:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa50e42c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+16:10415:x1873946287837184:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:1.0:1787134749.703562:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa50e42c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+17:10415:x1873946287837184:12345-192.168.202.36@tcp:35:bash.0 Request processed in 273us (492us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787134749.703572:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:2.0:1787134749.775429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134749.775653:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287837440 00000100:00100000:1.0:1787134749.775667:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287837440 00000100:00100000:1.0:1787134749.775738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:1.0:1787134749.775749:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+17:10425:x1873946287837440:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134749.775784:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134749.775812:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070366 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134749.776114:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787134749.776351:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906277 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070366 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.776378:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:1.0:1787134749.776381:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134749.776386:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070366 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134749.776399:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deac00, rc 0) 00000100:00100000:1.0:1787134749.776478:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+18:10425:x1873946287837440:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 731us (1069us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787134749.776486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:2.0:1787134749.781073:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134749.781345:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287837568 00000100:00100000:0.0:1787134749.781358:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287837568 00000100:00100000:0.0:1787134749.781437:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:0.0:1787134749.781452:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+18:10425:x1873946287837568:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:0.0:1787134749.781554:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.781579:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.781593:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.781613:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.781620:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.781625:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782096:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782114:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782121:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787134749.782204:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782218:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782226:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782232:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782238:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134749.782242:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782251:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782264:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:0.0:1787134749.782267:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134749.782273:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782280:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906285 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782300:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782306:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782312:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782317:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134749.782320:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782326:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782334:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa44db2700) 00010000:00010000:0.0:1787134749.782336:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134749.782339:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782345:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90628c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782361:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782368:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782375:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782385:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134749.782389:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782395:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782404:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:0.0:1787134749.782406:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134749.782409:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.782416:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134749.782535:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+18:10425:x1873946287837568:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1083us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134749.782545:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:3.0:1787134749.785224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134749.785488:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287837824 00000100:00100000:0.0:1787134749.785502:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287837824 00000100:00100000:0.0:1787134749.785627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:0.0:1787134749.785639:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+18:10425:x1873946287837824:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134749.786376:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+19:10425:x1873946287837824:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 735us (1160us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787134749.786387:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787134749.820546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134749.821046:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287838080 00000100:00100000:0.0:1787134749.821058:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287838080 00000100:00100000:0.0:1787134749.821130:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:0.0:1787134749.821191:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+19:10428:x1873946287838080:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134749.821218:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134749.821238:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90629a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907036d expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821319:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821334:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821346:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821362:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821369:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821376:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821772:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9062af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821782:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9062af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821790:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9062af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134749.821812:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787134749.821923:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821931:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821937:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821942:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134749.821947:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821954:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821967:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:0.0:1787134749.821970:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134749.821975:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821981:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae9062a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821993:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.821998:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.822014:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.822020:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134749.822023:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.822029:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.822037:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa44db2700) 00010000:00010000:0.0:1787134749.822039:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134749.822042:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.822047:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9062a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.822092:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90629a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907036d expref: 22 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.822106:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9062af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907036d expref: 21 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.822113:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:0.0:1787134749.822115:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134749.822118:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450000, rc 0) 00000100:00100000:0.0:1787134749.822235:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+21:10428:x1873946287838080:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1081us (1701us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787134749.822253:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:3.0:1787134749.825463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134749.826644:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287838208 00000100:00100000:0.0:1787134749.826659:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287838208 00000100:00100000:0.0:1787134749.826727:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:0.0:1787134749.826741:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+21:10428:x1873946287838208:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:0.0:1787134749.826822:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.826841:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.826852:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.826893:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.826900:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.826906:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.826912:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134749.826917:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.826924:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.826937:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:0.0:1787134749.826954:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787134749.826959:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.826966:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134749.827048:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+21:10428:x1873946287838208:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 310us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134749.827058:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:2.0:1787134749.827071:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134749.827094:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287838336 00000100:00100000:0.0:1787134749.827099:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287838336 00000100:00100000:0.0:1787134749.827138:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:0.0:1787134749.827146:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+21:2351:x1873946287838336:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134749.827280:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134749.827298:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9062af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907036d expref: 21 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134749.827309:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:0.0:1787134749.827312:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134749.827333:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+20:2351:x1873946287838336:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 189us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134749.827340:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:0.0:1787134749.836088:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134749.837431:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287838592 00000100:00100000:1.0:1787134749.837449:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287838592 00000100:00100000:1.0:1787134749.837553:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:1.0:1787134749.837566:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+20:10428:x1873946287838592:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787134749.837827:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+21:10428:x1873946287838592:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 263us (1749us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787134749.837835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:2.0:1787134750.063951:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134750.064135:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287838848 00000100:00100000:0.0:1787134750.064146:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287838848 00000100:00100000:0.0:1787134750.064311:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:0.0:1787134750.064324:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+21:10446:x1873946287838848:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:0.0:1787134750.064363:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134750.064386:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9062c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070374 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134750.064510:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134750.064526:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134750.064541:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134750.064553:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787134750.064985:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9062c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070374 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134750.065006:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070374 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134750.065015:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:0.0:1787134750.065018:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787134750.065021:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450200, rc 0) 00000100:00100000:0.0:1787134750.065212:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+23:10446:x1873946287838848:12345-192.168.202.36@tcp:101:cat.0 Request processed in 890us (1388us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787134750.065221:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00080000:3.0:1787134750.074404:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134750.103354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134750.103477:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287838976 00000100:00100000:1.0:1787134750.103491:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287838976 00000100:00100000:1.0:1787134750.103558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:1.0:1787134750.103569:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+23:10447:x1873946287838976:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134750.103598:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134750.103620:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907037b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.103711:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae9062e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.103748:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae9062e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.103761:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae9062e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134750.104024:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787134750.104029:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134750.104107:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae9062e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.104138:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907037b expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.104208:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae9062e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907037b expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.104218:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134750.104221:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134750.104224:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb400, rc 0) 00000100:00100000:1.0:1787134750.104298:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+24:10447:x1873946287838976:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 730us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134750.104306:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:2.0:1787134750.117209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134750.117422:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287839360 00000100:00100000:0.0:1787134750.117433:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287839360 00000100:00100000:0.0:1787134750.117500:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:0.0:1787134750.117524:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+24:10447:x1873946287839360:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134750.118139:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+25:10447:x1873946287839360:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 613us (985us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787134750.118150:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:2.0:1787134750.124070:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134750.124224:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287839488 00000100:00100000:3.0:1787134750.124240:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287839488 00000100:00100000:3.0:1787134750.124308:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787134750.124320:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+25:10447:x1873946287839488:12345-192.168.202.36@tcp:103:lfs.0 00010000:00010000:3.0:1787134750.124340:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787134750.124372:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907035f expref: 25 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134750.124398:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9062cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070374 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134750.124411:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070320 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134750.124421:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:3.0:1787134750.124434:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134750.124499:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+22:10447:x1873946287839488:12345-192.168.202.36@tcp:103:lfs.0 Request processed in 180us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134750.124506:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:2.0:1787134750.132228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134750.132324:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287839616 00000100:00100000:1.0:1787134750.132336:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287839616 00000100:00100000:1.0:1787134750.132397:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00100000:1.0:1787134750.132405:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+22:10447:x1873946287839616:12345-192.168.202.36@tcp:58:lfs.0 00010000:00010000:1.0:1787134750.132529:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.132550:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.132563:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787134750.133314:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134750.133494:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787134750.133552:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787134750.133658:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+22:10447:x1873946287839616:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 1250us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134750.133668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 66 00010000:00010000:3.0:1787134750.144449:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134750.157638:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134750.157919:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287839744 00000100:00100000:1.0:1787134750.157933:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287839744 00000100:00100000:1.0:1787134750.158082:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:1.0:1787134750.158096:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+22:10449:x1873946287839744:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134750.158121:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134750.158147:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae9062ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070382 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158259:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158276:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158288:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158326:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158334:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158340:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158604:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158614:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158619:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134750.158650:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787134750.158653:0:11472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134750.158669:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158678:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158686:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158691:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158702:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158708:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deba00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134750.158711:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158718:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158730:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134750.158732:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134750.158736:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158741:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae9062f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158750:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158753:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158757:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158760:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134750.158762:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158771:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158776:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa50ade200) 00010000:00010000:1.0:1787134750.158777:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134750.158778:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158781:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae9062fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.158809:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae9062ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070382 expref: 24 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.159006:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070382 expref: 23 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134750.159012:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa50ade700) 00010000:00010000:1.0:1787134750.159013:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134750.159015:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea800, rc 0) 00000100:00100000:1.0:1787134750.159083:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+23:10449:x1873946287839744:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 992us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134750.159089:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 67 00000040:00080000:0.0:1787134750.782812:0:11993:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134750.782826:0:11993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134750.782874:0:11993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787134750.782881:0:11993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787134750.979098:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134750.979109:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134750.979180:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787134750.979187:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787134750.980414:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946311988096:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787134750.980550:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7ae6ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134750.984591:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946311988096:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787134750.986225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134750.986514:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287839872 00000100:00100000:1.0:1787134750.986524:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287839872 00000100:00100000:1.0:1787134750.986647:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:1.0:1787134750.986660:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:486fb1ad-4266-4864-b299-111c5140734b+23:10461:x1873946287839872:12345-192.168.202.36@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787134750.986771:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:486fb1ad-4266-4864-b299-111c5140734b+23:10461:x1873946287839872:12345-192.168.202.36@tcp:900:lhsmtool_posix.0 Request processed in 113us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134750.986781:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:3.0:1787134750.989769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134750.990124:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287840000 00000100:00100000:1.0:1787134750.990136:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287840000 00000100:00100000:1.0:1787134750.990228:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:1.0:1787134750.990241:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+23:10461:x1873946287840000:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787134750.990279:0:5835:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787134750.990933:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+23:10461:x1873946287840000:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 693us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134750.990941:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:1.0:1787134751.008405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134751.008604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287840128 00000100:00100000:0.0:1787134751.008616:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287840128 00000100:00100000:0.0:1787134751.008682:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:0.0:1787134751.008692:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+23:10461:x1873946287840128:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787134751.008772:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.008791:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.008815:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.008875:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.008884:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.008891:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.008919:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.008926:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.008932:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134751.008975:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787134751.008993:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134751.009007:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009018:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009023:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009029:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009044:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134751.009049:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009057:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009069:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:0.0:1787134751.009071:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134751.009075:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009082:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae90630a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009094:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009099:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009105:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009110:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134751.009113:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009119:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009134:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff98aa44db2700) 00010000:00010000:0.0:1787134751.009137:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134751.009140:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009145:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906311 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009176:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009182:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009188:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009193:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134751.009196:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009201:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009208:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa50ade700) 00010000:00010000:0.0:1787134751.009210:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134751.009212:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.009217:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134751.009302:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+23:10461:x1873946287840128:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 611us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134751.009311:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:3.0:1787134751.016045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.016200:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287840384 00000100:00100000:1.0:1787134751.016212:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287840384 00000100:00100000:1.0:1787134751.016275:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:1.0:1787134751.016286:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+23:10461:x1873946287840384:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787134751.016310:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134751.016338:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90631f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070389 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.016450:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.016467:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.016482:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134751.016507:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787134751.017329:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.017340:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.017348:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.017354:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134751.017360:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.017368:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.017381:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa50ade700) 00010000:00010000:1.0:1787134751.017384:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134751.017388:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.017395:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.017440:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90631f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070389 expref: 25 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.017450:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:1.0:1787134751.017452:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134751.017463:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae90631f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070389 expref: 25 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.017473:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deba00, rc 0) 00000100:00100000:1.0:1787134751.017544:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+24:10461:x1873946287840384:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1260us (1512us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787134751.017552:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:1.0:1787134751.033003:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134751.033186:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287840512 00000100:00100000:3.0:1787134751.033198:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287840512 00000100:00100000:3.0:1787134751.033279:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:3.0:1787134751.033290:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+24:10461:x1873946287840512:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787134751.033328:0:5835:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787134751.033446:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+24:10461:x1873946287840512:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 158us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134751.033454:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:3.0:1787134751.036937:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134751.038178:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287840768 00000100:00100000:3.0:1787134751.038189:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287840768 00000100:00100000:3.0:1787134751.038258:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:3.0:1787134751.038269:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+24:10461:x1873946287840768:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134751.038291:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134751.038295:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787134751.038327:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb400/0x69932dacae9062e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907037b expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.038345:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:3.0:1787134751.038351:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787134751.038366:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906334 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070390 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787134751.049446:0:11683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787134751.049887:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90633b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.049907:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90633b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.049934:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90633b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.050264:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906334 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070390 expref: 26 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.050358:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90633b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070390 expref: 25 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.050369:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa42a7c600) 00010000:00010000:3.0:1787134751.050372:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787134751.050376:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7ae00, rc 0) 00000100:00100000:3.0:1787134751.050460:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+25:10461:x1873946287840768:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 12192us (13535us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787134751.050471:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:3.0:1787134751.055885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.056118:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287841024 00000100:00100000:1.0:1787134751.056131:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287841024 00000100:00100000:1.0:1787134751.056217:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 73 00000100:00100000:1.0:1787134751.056227:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+25:10461:x1873946287841024:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787134751.056362:0:11472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134751.056395:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90633b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070390 expref: 25 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.056419:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa42a7c600) 00010000:00010000:1.0:1787134751.056437:0:11472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134751.056467:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.056483:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.056495:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.056530:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.056960:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.056968:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057391:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057399:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057407:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057414:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deba00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134751.057420:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057430:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057440:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134751.057443:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134751.057448:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057455:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906349 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057466:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057478:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057484:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057490:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134751.057494:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057500:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057509:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x685541e (ffff98aa50ade000) 00010000:00010000:1.0:1787134751.057511:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134751.057514:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.057520:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906350 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x685541e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134751.057839:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+24:10461:x1873946287841024:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 1609us (1961us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787134751.057849:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 73 00000100:00100000:3.0:1787134751.063266:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.068750:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287841152 00000100:00100000:1.0:1787134751.068768:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287841152 00000100:00100000:1.0:1787134751.069111:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:1.0:1787134751.069123:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+24:10461:x1873946287841152:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787134751.069145:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134751.069194:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906357 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070397 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.069251:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.069267:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.069279:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.069396:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906357 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070397 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.069412:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070397 expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.069422:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:1.0:1787134751.069425:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787134751.069429:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6800, rc 0) 00000100:00100000:1.0:1787134751.069504:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+25:10461:x1873946287841152:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 384us (6246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134751.069511:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:2.0:1787134751.079411:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134751.089720:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287841408 00000100:00100000:3.0:1787134751.089739:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287841408 00000100:00100000:3.0:1787134751.090911:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:3.0:1787134751.090928:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+25:10461:x1873946287841408:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787134751.091035:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.091054:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.091078:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787134751.091539:0:11683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787134751.091552:0:11683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367058392732ns, next at 368058389299ns, rc = 0 00000004:00010000:3.0:1787134751.091730:0:11683:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000006b9db175 reply state 00000000015cd6c7 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134751.091741:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787134751.091880:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+27:10461:x1873946287841408:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 955us (12910us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787134751.091888:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:0.0:1787134751.112203:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.112273:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287841536 00000100:00100000:1.0:1787134751.112292:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287841536 00000100:00100000:1.0:1787134751.112355:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:1.0:1787134751.112366:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+27:10461:x1873946287841536:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787134751.112391:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134751.112421:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907039e expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.112483:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907039e expref: 28 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.112497:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907039e expref: 28 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.112515:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:1.0:1787134751.112518:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787134751.112522:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7000, rc 0) 00000100:00100000:1.0:1787134751.112746:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+28:10461:x1873946287841536:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 379us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134751.112754:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 76 00010000:00010000:2.0:1787134751.113425:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.113438:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.113445:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.113451:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134751.113456:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.113463:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.113476:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:2.0:1787134751.113479:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787134751.113482:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.113502:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906365 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134751.134071:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.137899:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287841664 00000100:00100000:1.0:1787134751.137917:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287841664 00000100:00100000:0.0:1787134751.140547:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787134751.140560:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1873946287841664:12345-192.168.202.36@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787134751.140615:0:6681:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from 486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:0.0:1787134751.140649:0:6681:0:(genops.c:1406:class_connect()) connect: client 486fb1ad-4266-4864-b299-111c5140734b, cookie 0x69932dacae906373 00002000:00100000:0.0:1787134751.140661:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 486fb1ad-4266-4864-b299-111c5140734b/ffff98aa7f6b8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787134751.140686:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1787134751.140956:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787134751.141356:0:6681:0:(import.c:65:import_set_state_nolock()) ffff98aa7f6bb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787134751.141436:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2348:x1873946287841664:12345-192.168.202.36@tcp:8:lhsmtool_posix.0 Request processed in 875us (7376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134751.141446:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787134751.146809:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134751.146963:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287841792 00000100:00100000:2.0:1787134751.146976:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287841792 00000100:00100000:2.0:1787134751.147193:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:2.0:1787134751.147203:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+6:0:x1873946287841792:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787134751.151315:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787134751.168793:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134751.205828:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+7:0:x1873946287841792:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 58603us (59011us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787134751.205845:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000001:00100000:1.0:1787134751.206557:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000001:00080000:1.0:1787134751.206577:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1787134751.212911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134751.213491:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287842048 00000100:00100000:3.0:1787134751.213503:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287842048 00000100:00100000:3.0:1787134751.213673:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:3.0:1787134751.213687:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+27:10461:x1873946287842048:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787134751.214014:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+28:10461:x1873946287842048:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 330us (1117us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787134751.214023:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:1.0:1787134751.217469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134751.217663:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287842304 00000100:00100000:2.0:1787134751.217673:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287842304 00000100:00100000:2.0:1787134751.217738:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:2.0:1787134751.217752:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+28:10461:x1873946287842304:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787134751.217878:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+28:10461:x1873946287842304:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 132us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134751.217887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:2.0:1787134751.221692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134751.221940:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287842432 00000100:00100000:3.0:1787134751.224645:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287842432 00000100:00100000:2.0:1787134751.235717:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:2.0:1787134751.235733:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+28:10461:x1873946287842432:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134751.235768:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134751.235794:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90637a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703a5 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.235904:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae906381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.235920:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae906381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.235963:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae906381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134751.237403:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134751.237432:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae906381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.237464:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90637a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703a5 expref: 30 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.237482:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae906381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703a5 expref: 29 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.237488:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:2.0:1787134751.237491:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787134751.237493:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97600, rc 0) 00000100:00100000:2.0:1787134751.237633:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+29:10461:x1873946287842432:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1904us (15952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134751.237639:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:1.0:1787134751.243722:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134751.243866:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287842560 00000100:00100000:2.0:1787134751.243878:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287842560 00000100:00100000:2.0:1787134751.243940:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:2.0:1787134751.243960:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287842560:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134751.245051:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134751.245239:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703ac expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787134751.245269:0:11954:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a85831f, blocks: 0x1 00010000:00010000:3.0:1787134751.245292:0:11954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1787134751.245297:0:11954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134751.245307:0:11954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ac expref: 6 pid: 11954 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.245330:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ac expref: 6 pid: 11954 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.245346:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7bc00, rc 0) 00000100:00100000:3.0:1787134751.245421:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287842560:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1463us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134751.245429:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:0.0:1787134751.249078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134751.249146:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287842816 00000100:00100000:3.0:1787134751.249186:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287842816 00000100:00100000:3.0:1787134751.249258:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:3.0:1787134751.249269:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+29:10461:x1873946287842816:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787134751.249404:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+29:10461:x1873946287842816:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 136us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134751.249412:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:3.0:1787134751.256847:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134751.259786:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287842944 00000100:00100000:0.0:1787134751.259804:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287842944 00000100:00100000:0.0:1787134751.259909:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:0.0:1787134751.259919:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:10461:x1873946287842944:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134751.260132:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134751.260154:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703b3 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.260264:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ac expref: 7 pid: 11954 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.260275:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134751.260289:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134751.260296:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.260341:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ac expref: 7 pid: 11954 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.260357:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ac expref: 7 pid: 11954 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134751.260374:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1873946311988224:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134751.260487:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787134751.267766:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1873946311988224:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134751.267824:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.267850:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451400, rc 0) 00000100:00100000:0.0:1787134751.267937:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:10461:x1873946287842944:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 8019us (11102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134751.267955:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:1.0:1787134751.288451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134751.288992:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287843072 00000100:00100000:0.0:1787134751.289005:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287843072 00010000:00010000:0.0:1787134751.289064:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ac expref: 7 pid: 11954 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134751.289116:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:0.0:1787134751.289127:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287843072:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134751.289146:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134751.289209:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ac expref: 7 pid: 11954 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.289226:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ac expref: 7 pid: 11954 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.289254:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae906388 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ac expref: 7 pid: 11954 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.289285:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134751.289290:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134751.289300:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.289312:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.289355:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134751.289387:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1873946311988352:192.168.202.36@tcp:105: 00000100:00100000:0.0:1787134751.289486:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787134751.304917:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1873946311988352:192.168.202.36@tcp:105: 00010000:00010000:0.0:1787134751.304964:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134751.305040:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287843072:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 15913us (16600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134751.305054:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:1.0:1787134751.306232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134751.307408:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287843200 00000100:00100000:0.0:1787134751.307421:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287843200 00002000:00100000:0.0:1787134751.307481:0:6688:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98aa81023800 x1873946287843200/t0(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:687/0 lens 504/0 e 0 to 0 dl 1787134762 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787134751.307493:0:6688:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa81023800 with x1873946287843200 ext(0->8) 00002000:00010000:0.0:1787134751.307499:0:6688:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa81023800 00000100:00100000:0.0:1787134751.307543:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:0.0:1787134751.307553:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287843200:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787134751.313979:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287843200:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 Request processed in 6413us (7741us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787134751.313997:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00002000:00100000:0.0:1787134751.314014:0:6688:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98aa81023800 x1873946287843200/t4294967302(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:687/0 lens 504/448 e 0 to 0 dl 1787134762 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787134751.314025:0:6688:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa81023800 with x1873946287843200 ext(0->8) 00002000:00010000:0.0:1787134751.314032:0:6688:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa81023800 00000100:00100000:1.0:1787134751.324460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134751.325835:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287843328 00000100:00100000:0.0:1787134751.325853:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287843328 00000100:00100000:0.0:1787134751.325958:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:0.0:1787134751.325970:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+29:10461:x1873946287843328:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787134751.415687:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:1.0:1787134751.415717:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:1.0:1787134751.415735:0:5858:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1787134751.416045:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1787134751.416056:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1787134751.416206:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311988480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787134751.416278:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134751.416342:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311988480 00000100:00100000:1.0:1787134751.416350:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311988480 00000100:00100000:1.0:1787134751.416399:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787134751.416408:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa55146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311988480:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787134751.416668:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787134751.416680:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00010000:1.0:1787134751.416879:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787134751.416884:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787134751 00002000:00010000:1.0:1787134751.416886:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787134751.416888:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787134751 -> 1787134751 00002000:00010000:1.0:1787134751.416891:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787134751.417057:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa55146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1873946311988480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 650us (778us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787134751.417067:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787134751.417253:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134751.417441:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+13:10461:x1873946287843328:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 91472us (92995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134751.417486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 80 00000004:00080000:2.0:1787134751.419679:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa81022680/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787134751.419710:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311988480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787134751.420003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134751.420087:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287843456 00000100:00100000:0.0:1787134751.420093:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287843456 00000100:00100000:0.0:1787134751.420147:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:0.0:1787134751.420171:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287843456:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787134751.474074:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1787134751.474331:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1787134751.474832:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287843456:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 54669us (54825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134751.474844:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:3.0:1787134751.478475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.478697:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287843712 00000100:00100000:1.0:1787134751.478708:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287843712 00000100:00100000:1.0:1787134751.478782:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:1.0:1787134751.478793:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+13:10461:x1873946287843712:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787134751.478877:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134751.478908:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae906381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703a5 expref: 13 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.478929:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:1.0:1787134751.478934:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134751.478965:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.479085:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.479097:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134751.479423:0:11683:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000c15fbc37 reply state 00000000d85b0c6b transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134751.479434:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787134751.480041:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+14:10461:x1873946287843712:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 769us (1093us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787134751.480054:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 81 00010000:00010000:1.0:1787134751.485927:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.485948:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.485957:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.485990:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134751.485997:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.486006:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.486024:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:1.0:1787134751.486027:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134751.486032:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.486039:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906396 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134751.487678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134751.488620:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287843840 00000100:00100000:0.0:1787134751.488632:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287843840 00000100:00100000:0.0:1787134751.488698:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:0.0:1787134751.488710:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287843840:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787134751.489342:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787134751.489347:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787134751 -> 1787134750 00002000:00010000:1.0:1787134751.489350:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787134749 00002000:00010000:1.0:1787134751.489352:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787134751 -> 1787134750 00002000:00010000:1.0:1787134751.489355:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787134751.489434:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:2352:x1873946287843840:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 725us (1881us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787134751.489445:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:2.0:1787134751.492613:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134751.492717:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287844096 00000100:00100000:3.0:1787134751.492732:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287844096 00000100:00100000:3.0:1787134751.492799:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:3.0:1787134751.492818:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+13:10461:x1873946287844096:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787134751.492903:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.492922:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070397 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.492931:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.492971:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070397 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.492994:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070397 expref: 13 pid: 5836 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134751.493010:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311988608:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134751.493121:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787134751.497311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.497403:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287844224 00000100:00100000:1.0:1787134751.497412:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287844224 00010000:00010000:1.0:1787134751.497460:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070397 expref: 14 pid: 5836 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134751.497493:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:1.0:1787134751.497512:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+14:2352:x1873946287844224:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134751.497529:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134751.497535:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070397 expref: 14 pid: 5836 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.497549:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070397 expref: 14 pid: 5836 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.497611:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:1.0:1787134751.497618:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.497628:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.497645:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.497671:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134751.497740:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+14:2352:x1873946287844224:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 229us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134751.497747:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00010000:00010000:3.0:1787134751.498521:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae90635e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070397 expref: 13 pid: 5836 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134751.498540:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311988608:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134751.498561:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.498584:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.498590:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.498623:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.498630:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.498637:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.498644:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134751.498649:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.498656:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.498668:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:3.0:1787134751.498671:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787134751.498675:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.498681:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90639d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134751.498783:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+12:10461:x1873946287844096:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 Request processed in 5975us (6180us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787134751.498797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:0.0:1787134751.505441:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.505547:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287844352 00000100:00100000:1.0:1787134751.505568:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287844352 00000100:00100000:1.0:1787134751.505636:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:1.0:1787134751.505648:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287844352:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787134751.505701:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.505752:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.505762:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134751.505766:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134751.505771:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.505819:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.505836:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 7 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134751.505861:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1873946311988736:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134751.505950:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa434b9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134751.511320:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134751.511407:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287844480 00000100:00100000:0.0:1787134751.511416:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287844480 00010000:00010000:0.0:1787134751.511458:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 8 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134751.511504:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:0.0:1787134751.511513:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287844480:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134751.511529:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134751.511553:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 8 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.511567:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 8 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.511613:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787134751.511619:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787134751.511626:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.511637:0:7620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.511657:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134751.511720:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287844480:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 207us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134751.511727:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00010000:00010000:3.0:1787134751.511840:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029044bac/0x69932dacae90638f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703b3 expref: 7 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134751.511867:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1873946311988736:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134751.511890:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.511901:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.511908:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.511934:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.511942:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.511949:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.511957:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134751.511961:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.511985:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.511998:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.512005:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae9063a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134751.512051:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287844352:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 6406us (6623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134751.512058:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:2.0:1787134751.517256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.517357:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287844736 00000100:00100000:1.0:1787134751.517366:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287844736 00000100:00100000:1.0:1787134751.517421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:1.0:1787134751.517432:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+12:10461:x1873946287844736:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787134751.517518:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.517548:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.517574:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.517793:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.517815:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907039e expref: 13 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.517826:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.517870:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907039e expref: 13 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.517885:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907039e expref: 13 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134751.517898:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81020700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946311988864:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134751.518240:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa434b9240 going to sleep for 11 seconds 00000100:00100000:1.0:1787134751.521323:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81020700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946311988864:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134751.521352:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134751.522820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.523022:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287844864 00000100:00100000:1.0:1787134751.523031:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287844864 00010000:00010000:1.0:1787134751.523072:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907039e expref: 14 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134751.523136:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:1.0:1787134751.523147:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+14:2352:x1873946287844864:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134751.523190:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134751.523197:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907039e expref: 14 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.523209:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907039e expref: 14 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.523230:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae90636c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907039e expref: 14 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.523244:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:1.0:1787134751.523248:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.523258:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.523277:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.523298:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134751.523351:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+13:2352:x1873946287844864:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 206us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134751.523358:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00010000:00010000:2.0:1787134751.524191:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.524202:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787134751.524423:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787134751.524602:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787134751.524651:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787134751.524771:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1873946311988992:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787134751.524841:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134751.524882:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50886e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134751.525336:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311988992 00000100:00100000:1.0:1787134751.525351:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311988992 00000100:00100000:1.0:1787134751.525402:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787134751.525410:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1873946311988992:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787134751.525490:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1873946311988992:12345-0@lo:1000:mdt00_000.0 Request processed in 81us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134751.525497:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787134751.525573:0:5835:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787134751.525578:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98aa81022680, transno 4294967303 00000100:00100000:2.0:1787134751.525597:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1873946311988992:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787134751.527207:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787134751.527514:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1873946311989120:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787134751.527664:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134751.527699:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50886f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787134751.527793:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311989120 00000100:00100000:1.0:1787134751.527810:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311989120 00000100:00100000:1.0:1787134751.527860:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787134751.527870:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1873946311989120:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787134751.528359:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1873946311989120:12345-0@lo:1000:mdt00_000.0 Request processed in 489us (693us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787134751.528366:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787134751.528521:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1873946311989120:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787134751.529120:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529148:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529184:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529192:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134751.529198:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529207:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529226:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade100) 00010000:00010000:2.0:1787134751.529229:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134751.529234:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529240:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529658:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529666:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529671:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529676:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deac00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134751.529686:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529691:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529700:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa50ade700) 00010000:00010000:2.0:1787134751.529703:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134751.529706:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.529713:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae9062e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.530035:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.530054:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070382 expref: 16 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.530063:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.530101:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070382 expref: 16 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134751.530117:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070382 expref: 16 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134751.530132:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946311989248:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134751.530317:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50886f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787134751.533586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134751.533694:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287844992 00000100:00100000:0.0:1787134751.533703:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287844992 00010000:00010000:0.0:1787134751.533750:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070382 expref: 17 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134751.533794:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:0.0:1787134751.533809:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+17:2352:x1873946287844992:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134751.533824:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134751.533830:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070382 expref: 17 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.533843:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070382 expref: 17 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.533893:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa50ade700) 00010000:00010000:0.0:1787134751.533899:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.533908:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.533918:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.533935:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134751.533983:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+17:2352:x1873946287844992:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 181us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134751.533991:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00010000:00010000:1.0:1787134751.535377:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906303 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070382 expref: 16 pid: 11472 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134751.535395:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946311989248:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134751.535420:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535428:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535434:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535447:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535469:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535477:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535482:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134751.535486:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535494:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535506:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa50ade700) 00010000:00010000:1.0:1787134751.535508:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134751.535512:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535518:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9063b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535590:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535597:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535603:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535607:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134751.535615:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535622:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535630:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa50ade700) 00010000:00010000:1.0:1787134751.535632:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787134751.535635:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.535641:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134751.536053:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+15:10461:x1873946287844736:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 18621us (18804us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787134751.536063:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 83 00000020:00080000:1.0:1787134751.536068:0:5835:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787134751.538841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134751.539037:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287845248 00000100:00100000:1.0:1787134751.539047:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287845248 00000100:00100000:1.0:1787134751.539093:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:1.0:1787134751.539103:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+15:10461:x1873946287845248:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787134751.540388:0:5839:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787134751.540511:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787134751.540639:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.540659:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.540673:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.540692:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.540699:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.540706:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134751.540773:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787134751.540918:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+17:10461:x1873946287845248:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1812us (2083us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787134751.540928:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00000020:00080000:1.0:1787134751.540933:0:5839:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787134751.541683:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134751.541690:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134751.541752:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787134751.541760:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787134751.543591:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134751.543604:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.543616:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134751.543620:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.543632:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.543649:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98aa50ade200) 00010000:00010000:3.0:1787134751.543651:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787134751.543656:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134751.543681:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134751.543889:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134751.543891:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134751.543893:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134752.135678:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787134752.140677:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311989376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787134752.140756:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134752.140942:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311989376 00000100:00100000:1.0:1787134752.140951:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311989376 00000100:00100000:1.0:1787134752.141023:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787134752.141033:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1873946311989376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134752.141071:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134752.141120:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1873946311989376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134752.141127:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787134752.141943:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787134752.141993:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311989376:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787134752.192372:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787134752.580220:0:12046:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787134752.580230:0:12046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787134752.580275:0:12046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787134752.580284:0:12046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787134752.666233:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.666473:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287845504 00000100:00100000:1.0:1787134752.666485:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287845504 00000100:00100000:1.0:1787134752.666577:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:1.0:1787134752.666588:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+17:10478:x1873946287845504:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134752.666613:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134752.666638:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae9063c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703ba expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.666929:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.666944:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.666957:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134752.666969:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787134752.667131:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae9063c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ba expref: 20 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.667148:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ba expref: 19 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.667181:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134752.667185:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787134752.667189:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6e00, rc 0) 00000100:00100000:1.0:1787134752.667266:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+19:10478:x1873946287845504:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 680us (1043us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787134752.667274:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00080000:3.0:1787134752.667359:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134752.669417:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.669460:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287845632 00000100:00100000:1.0:1787134752.669472:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287845632 00000100:00100000:1.0:1787134752.669528:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:1.0:1787134752.669540:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+19:10478:x1873946287845632:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:1.0:1787134752.671786:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.671814:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.671828:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.671861:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.671868:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.671874:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672315:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672325:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672332:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134752.672385:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672401:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672413:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672420:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672427:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134752.672433:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672441:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672455:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134752.672459:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134752.672464:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672471:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672480:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672487:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672508:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672513:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134752.672522:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672528:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672536:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa50ade700) 00010000:00010000:1.0:1787134752.672539:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134752.672541:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672547:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672563:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672569:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672574:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672579:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134752.672582:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672587:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672594:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa50ade000) 00010000:00010000:1.0:1787134752.672596:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134752.672605:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.672611:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134752.672710:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+19:10478:x1873946287845632:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 3168us (3293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134752.672721:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:0.0:1787134752.725466:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.725526:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287845888 00000100:00100000:1.0:1787134752.725550:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287845888 00000100:00100000:1.0:1787134752.725614:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:1.0:1787134752.725626:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+19:10481:x1873946287845888:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134752.725853:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134752.725875:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703c1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.725992:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.726007:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.726017:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.726033:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.726040:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.726059:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726650:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726675:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726702:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134752.726754:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787134752.726892:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726900:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726906:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726912:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134752.726916:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726923:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726937:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:0.0:1787134752.726940:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134752.726945:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726951:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae9063f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726963:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726969:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726981:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726987:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134752.726990:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.726995:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.727003:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa50ade000) 00010000:00010000:0.0:1787134752.727005:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134752.727007:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.727012:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae9063ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.727054:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae9063f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c1 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.727064:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c1 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.727069:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:0.0:1787134752.727071:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134752.727072:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450600, rc 0) 00000100:00100000:0.0:1787134752.727127:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+21:10481:x1873946287845888:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1503us (1686us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787134752.727144:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:3.0:1787134752.731620:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.731783:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287846016 00000100:00100000:1.0:1787134752.731795:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287846016 00000100:00100000:1.0:1787134752.731869:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:1.0:1787134752.731880:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+21:10481:x1873946287846016:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:1.0:1787134752.732090:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.732104:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.732112:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.732134:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.732139:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.732143:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.732147:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134752.732151:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.732172:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.732195:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:1.0:1787134752.732199:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134752.732204:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.732211:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134752.732313:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+21:10481:x1873946287846016:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 434us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134752.732322:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:3.0:1787134752.735056:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.735138:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287846272 00000100:00100000:1.0:1787134752.735148:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287846272 00000100:00100000:1.0:1787134752.735272:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:0.0:1787134752.735281:0:5839:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787134752.735285:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa50e41850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+21:10481:x1873946287846272:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134752.735291:0:5839:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1787134752.736005:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa50e41850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+22:10481:x1873946287846272:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 654us (888us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787134752.736013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:2.0:1787134752.777640:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.777873:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287846528 00000100:00100000:1.0:1787134752.777885:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287846528 00000100:00100000:1.0:1787134752.777948:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:1.0:1787134752.777960:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+22:10001:x1873946287846528:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134752.777985:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134752.778007:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae90641b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.778119:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.778135:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c1 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.778454:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.778490:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c1 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.778506:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c1 expref: 23 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134752.778590:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81022300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311989504:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134752.778689:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa434b9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787134752.780959:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81022300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311989504:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134752.780988:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134752.781283:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.781682:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287846656 00000100:00100000:1.0:1787134752.781691:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287846656 00010000:00010000:1.0:1787134752.781737:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c1 expref: 24 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134752.781779:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:1.0:1787134752.781790:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+24:2352:x1873946287846656:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134752.781805:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134752.781812:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c1 expref: 24 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.781851:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c1 expref: 24 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.781875:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c1 expref: 24 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.781893:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:1.0:1787134752.781898:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.781908:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.781916:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.781943:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134752.782012:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+23:2352:x1873946287846656:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 222us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134752.782020:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00010000:00010000:3.0:1787134752.782459:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134752.782470:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134752.782491:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787134752.782670:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae90641b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c8 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134752.782688:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c8 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134752.782711:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:3.0:1787134752.782714:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787134752.782717:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7800, rc 0) 00000100:00100000:3.0:1787134752.782751:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+23:10001:x1873946287846528:12345-192.168.202.36@tcp:101:bash.0 Request processed in 4794us (5124us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787134752.782757:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:3.0:1787134752.785383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134752.785577:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287846912 00000100:00100000:0.0:1787134752.785587:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287846912 00000100:00100000:0.0:1787134752.785653:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:0.0:1787134752.785664:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+23:10001:x1873946287846912:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:0.0:1787134752.785949:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.785967:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.785979:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787134752.786030:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787134752.786055:0:5835:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000029573a6f reply state 000000001aa54aa0 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134752.786064:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787134752.786111:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787134752.786534:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+27:10001:x1873946287846912:12345-192.168.202.36@tcp:36:bash.0 Request processed in 870us (1159us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787134752.786542:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 89 00000020:00080000:0.0:1787134752.786546:0:5835:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787134752.788760:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134752.788777:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134752.788785:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134752.788791:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134752.788806:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134752.788813:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134752.788829:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:3.0:1787134752.788832:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134752.788837:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134752.788851:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906430 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134752.789743:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134752.789835:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287847040 00000100:00100000:0.0:1787134752.789856:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287847040 00000100:00100000:0.0:1787134752.789919:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 90 00000100:00100000:0.0:1787134752.789929:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+26:10001:x1873946287847040:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787134752.789963:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134752.789981:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906437 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703cf expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.790039:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906437 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703cf expref: 27 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.790054:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906437 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703cf expref: 27 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.790072:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:0.0:1787134752.790075:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787134752.790078:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451c00, rc 0) 00000100:00100000:0.0:1787134752.790135:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+27:10001:x1873946287847040:12345-192.168.202.36@tcp:101:bash.0 Request processed in 207us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134752.790143:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 90 00000100:00100000:2.0:1787134752.793379:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.793454:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287847168 00000100:00100000:1.0:1787134752.793465:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287847168 00000100:00100000:1.0:1787134752.793528:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:1.0:1787134752.793539:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+6:10001:x1873946287847168:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134752.793556:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134752.793577:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703d6 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787134752.793622:0:11954:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a85831e, atime: 0x6a85831d, ctime: 0x6a85831e, blocks: 0xb 00010000:00010000:1.0:1787134752.793645:0:11954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1787134752.793650:0:11954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134752.793660:0:11954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703d6 expref: 7 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.793684:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703d6 expref: 7 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.793698:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7200, rc 0) 00000100:00100000:1.0:1787134752.793766:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+7:10001:x1873946287847168:12345-192.168.202.36@tcp:101:bash.0 Request processed in 229us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134752.793774:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787134752.796698:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.796809:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287847296 00000100:00100000:1.0:1787134752.796819:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287847296 00002000:00010000:1.0:1787134752.796886:0:6686:0:(ofd_dev.c:2828:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787134752.796892:0:6686:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa7f5d0700 with x1873946287847296 ext(0->18446744073709551615) 00002000:00010000:1.0:1787134752.796905:0:6686:0:(ofd_dev.c:2833:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa7f5d0700. 00000100:00100000:1.0:1787134752.796948:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:1.0:1787134752.796958:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486fb1ad-4266-4864-b299-111c5140734b+7:2349:x1873946287847296:12345-192.168.202.36@tcp:10:bash.0 00002000:00010000:1.0:1787134752.797306:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787134752.797310:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787134750 -> 1787134753 00002000:00010000:1.0:1787134752.797312:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787134749 -> 1787134749 00002000:00010000:1.0:1787134752.797314:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787134750 -> 1787134753 00002000:00010000:1.0:1787134752.797331:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787134752.797409:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486fb1ad-4266-4864-b299-111c5140734b+8:2349:x1873946287847296:12345-192.168.202.36@tcp:10:bash.0 Request processed in 452us (721us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787134752.797418:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00002000:00010000:1.0:1787134752.797423:0:6686:0:(ofd_dev.c:2828:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787134752.797425:0:6686:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa7f5d0700 with x1873946287847296 ext(0->18446744073709551615) 00002000:00010000:1.0:1787134752.797430:0:6686:0:(ofd_dev.c:2833:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa7f5d0700. 00000100:00100000:3.0:1787134752.861897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.862018:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287847424 00000100:00100000:1.0:1787134752.862029:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287847424 00000100:00100000:1.0:1787134752.862092:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:1.0:1787134752.862102:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+27:10495:x1873946287847424:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:1.0:1787134752.862209:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862228:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862240:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862256:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862273:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862280:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862577:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862594:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862601:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134752.862646:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862660:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862668:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862676:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862683:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134752.862688:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862697:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862710:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134752.862713:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134752.862718:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862725:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906445 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862746:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862753:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862759:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862764:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134752.862767:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862774:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862781:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa50ade500) 00010000:00010000:1.0:1787134752.862783:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134752.862786:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862792:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae90644c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862805:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862811:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862817:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862827:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134752.862830:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862836:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862859:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:1.0:1787134752.862861:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134752.862865:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.862870:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906453 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134752.862943:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+27:10495:x1873946287847424:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 841us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134752.862952:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:2.0:1787134752.902892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134752.903311:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287847680 00000100:00100000:0.0:1787134752.903324:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287847680 00000100:00100000:0.0:1787134752.903452:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00100000:0.0:1787134752.903464:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+27:10498:x1873946287847680:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134752.903483:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134752.903502:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90645a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703dd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.903618:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.903636:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.903646:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.903664:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.903668:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.903673:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904153:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90646f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904186:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90646f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904191:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90646f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134752.904201:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787134752.904282:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904287:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904297:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904301:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134752.904305:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904309:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904319:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:0.0:1787134752.904321:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134752.904324:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904328:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904337:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904341:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904345:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904348:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134752.904350:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904360:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904365:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa44db2f00) 00010000:00010000:0.0:1787134752.904366:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134752.904368:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904371:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae906468 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904408:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90645a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703dd expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904417:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90646f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703dd expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.904421:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:0.0:1787134752.904422:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787134752.904423:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451200, rc 0) 00000100:00100000:0.0:1787134752.904485:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+29:10498:x1873946287847680:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1026us (1606us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787134752.904491:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00100000:0.0:1787134752.911106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.912703:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287847808 00000100:00100000:1.0:1787134752.912716:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287847808 00000100:00100000:1.0:1787134752.912946:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:1.0:1787134752.912956:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+29:10498:x1873946287847808:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:1.0:1787134752.913023:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.913043:0:11472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c8 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.913054:0:11472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.913107:0:11472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c8 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.913122:0:11472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c8 expref: 29 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134752.913136:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81022300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311989632:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134752.913254:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa434b9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787134752.915530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134752.915590:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287848064 00000100:00100000:0.0:1787134752.915599:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287848064 00000100:00100000:0.0:1787134752.915696:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:0.0:1787134752.915709:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+30:9250:x1873946287848064:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787134752.915774:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81022300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311989632:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134752.915809:0:11472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134752.916075:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+31:9250:x1873946287848064:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 369us (555us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787134752.916084:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:2.0:1787134752.918154:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134752.918226:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287848192 00000100:00100000:0.0:1787134752.918237:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287848192 00010000:00010000:0.0:1787134752.918331:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c8 expref: 31 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134752.918377:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:0.0:1787134752.918387:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+31:2351:x1873946287848192:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134752.918403:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134752.918410:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c8 expref: 31 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.918424:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c8 expref: 31 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.918448:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906422 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703c8 expref: 31 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.918467:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:0.0:1787134752.918473:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.918483:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.918492:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134752.918534:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134752.918567:0:11472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.918576:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.918601:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.918606:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.918611:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.918619:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134752.918622:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.918636:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.918647:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00000100:00100000:0.0:1787134752.918664:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+30:2351:x1873946287848192:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 277us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134752.918673:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00010000:00010000:1.0:1787134752.918707:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134752.918711:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134752.918716:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90647d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134752.918752:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+29:10498:x1873946287847808:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 5797us (7655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134752.918760:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:2.0:1787134752.920866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134752.920969:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287848448 00000100:00100000:1.0:1787134752.920978:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287848448 00000100:00100000:1.0:1787134752.921014:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:1.0:1787134752.921023:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+29:10498:x1873946287848448:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787134752.921326:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+30:10498:x1873946287848448:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 303us (464us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787134752.921333:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:3.0:1787134753.013274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.013424:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287848704 00000100:00100000:2.0:1787134753.013434:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287848704 00000100:00100000:2.0:1787134753.013496:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:2.0:1787134753.013507:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+30:10509:x1873946287848704:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:2.0:1787134753.013532:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134753.013552:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906484 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.013624:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.013641:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.013654:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.013669:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.013677:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.013697:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014245:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014256:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014264:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134753.014274:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787134753.014360:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014368:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014375:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014381:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134753.014385:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014393:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014405:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134753.014408:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134753.014418:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014423:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90648b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014437:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014443:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014449:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014454:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134753.014457:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014463:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014471:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa59e99300) 00010000:00010000:2.0:1787134753.014474:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134753.014477:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014482:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014525:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906484 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703e4 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014551:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703e4 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.014559:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:2.0:1787134753.014562:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134753.014564:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97e00, rc 0) 00000100:00100000:2.0:1787134753.014630:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+32:10509:x1873946287848704:12345-192.168.202.36@tcp:101:cat.0 Request processed in 1124us (1376us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787134753.014637:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:2.0:1787134753.020853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.021019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287848960 00000100:00100000:0.0:1787134753.021029:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287848960 00000100:00100000:0.0:1787134753.021127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:0.0:1787134753.021137:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+32:10509:x1873946287848960:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:0.0:1787134753.021413:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+33:10509:x1873946287848960:12345-192.168.202.36@tcp:35:cat.0 Request processed in 277us (623us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787134753.021422:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:0.0:1787134753.068014:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.068274:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287849216 00000100:00100000:2.0:1787134753.068288:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287849216 00000100:00100000:2.0:1787134753.068365:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 95 00000100:00100000:2.0:1787134753.068375:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+33:10510:x1873946287849216:12345-192.168.202.36@tcp:36:rm.0 00010000:00010000:2.0:1787134753.068447:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787134753.068477:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703e4 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.068504:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90646f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703dd expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.068519:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae906437 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703cf expref: 31 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.068530:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa44db2600) 00010000:00010000:2.0:1787134753.068557:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134753.068579:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.068593:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.068606:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.068621:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.068628:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.068635:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.069083:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.069094:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.069102:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787134753.071095:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787134753.071108:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369037948411ns, next at 370037945736ns, rc = 0 00010000:00010000:2.0:1787134753.071202:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.071232:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.071243:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.071252:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072376:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072395:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072493:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134753.072523:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072531:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072538:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072544:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134753.072550:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072557:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072584:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99b00) 00010000:00010000:2.0:1787134753.072588:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787134753.072593:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072600:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9064b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072625:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072632:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072639:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072644:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134753.072647:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072653:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072660:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134753.072663:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134753.072666:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.072672:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae9064a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787134753.072693:0:5835:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000000fb48cac reply state 00000000d35702a5 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134753.072701:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134753.074007:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+32:10510:x1873946287849216:12345-192.168.202.36@tcp:36:rm.0 Request processed in 5624us (5994us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787134753.074020:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 95 00010000:00010000:1.0:1787134753.076445:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.076465:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.076474:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.076495:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134753.076500:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.076508:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.076526:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa59e99300) 00010000:00010000:1.0:1787134753.076529:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134753.076534:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.076541:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9064ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.078943:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134753.078960:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.078972:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134753.078977:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.078987:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.079006:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98aa59e99b00) 00010000:00010000:0.0:1787134753.079008:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787134753.079014:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.083171:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9064bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.083265:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134753.083269:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134753.083272:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134753.125550:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134753.125653:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287849472 00000100:00100000:1.0:1787134753.125664:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287849472 00000100:00100000:1.0:1787134753.125731:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 96 00000100:00100000:1.0:1787134753.125743:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+31:10516:x1873946287849472:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134753.125768:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134753.125788:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae9064c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703eb expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.125938:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.125972:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.125985:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.125999:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126006:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126013:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787134753.126584:0:11472:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787134753.126742:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126753:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126761:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126792:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126799:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126806:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126818:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134753.126822:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126851:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126865:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134753.126868:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134753.126872:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126879:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae9064ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134753.126894:0:11472:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000a2e0f0d3 reply state 000000002ef22c85 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134753.126903:0:11472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787134753.126932:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae9064c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703eb expref: 34 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126947:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703eb expref: 33 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.126955:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa50adee00) 00010000:00010000:1.0:1787134753.126957:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134753.126959:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7c00, rc 0) 00000100:00100000:1.0:1787134753.127028:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+34:10516:x1873946287849472:12345-192.168.202.36@tcp:101:bash.0 Request processed in 1287us (1486us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787134753.127041:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 96 00010000:00010000:3.0:1787134753.130201:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.130221:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.130230:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.130237:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134753.130242:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.130250:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.130634:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa50ade500) 00010000:00010000:3.0:1787134753.130639:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134753.130646:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.130653:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae9064d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134753.133533:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134753.133740:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287849600 00000100:00100000:1.0:1787134753.133750:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287849600 00000100:00100000:1.0:1787134753.133835:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:1.0:1787134753.133857:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:2349:x1873946287849600:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134753.133880:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134753.133904:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703f2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787134753.133935:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787134753.133958:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1787134753.133963:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134753.133972:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f2 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.133993:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f2 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.134009:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6c00, rc 0) 00000100:00100000:1.0:1787134753.134061:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+8:2349:x1873946287849600:12345-192.168.202.36@tcp:101:bash.0 Request processed in 207us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134753.134068:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00080000:3.0:1787134753.134315:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134753.138281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134753.138372:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287849728 00000100:00100000:3.0:1787134753.138392:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287849728 00000100:00100000:3.0:1787134753.138447:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:3.0:1787134753.138457:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+8:10516:x1873946287849728:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787134753.138475:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134753.138494:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90703f9 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.138527:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f2 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.138537:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134753.138542:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134753.138548:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.138581:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f2 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.138597:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f2 expref: 9 pid: 6681 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134753.138612:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1873946311989760:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134753.138708:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134753.141211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134753.141327:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1873946311989760:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134753.141363:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.141409:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7ae00, rc 0) 00000100:00100000:1.0:1787134753.141478:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+9:10516:x1873946287849728:12345-192.168.202.36@tcp:101:bash.0 Request processed in 3021us (3206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134753.141487:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:0.0:1787134753.142102:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287849856 00000100:00100000:0.0:1787134753.142110:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287849856 00010000:00010000:0.0:1787134753.142147:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f2 expref: 9 pid: 6681 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134753.142213:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:0.0:1787134753.142222:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+9:2351:x1873946287849856:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134753.142236:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134753.142257:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f2 expref: 9 pid: 6681 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.142369:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f2 expref: 9 pid: 6681 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.142395:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc79cd46/0x69932dacae9064e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f2 expref: 9 pid: 6681 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.142411:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134753.142415:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134753.142424:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.142450:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.142488:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134753.142504:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5822:1873946311989888:192.168.202.36@tcp:105: 00000100:00100000:0.0:1787134753.142614:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787134753.146076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.146313:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287850112 00000100:00100000:2.0:1787134753.146324:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287850112 00000100:00100000:2.0:1787134753.146385:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:2.0:1787134753.146397:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+33:10516:x1873946287850112:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:2.0:1787134753.146771:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+34:10516:x1873946287850112:12345-192.168.202.36@tcp:35:bash.0 Request processed in 375us (704us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787134753.146780:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787134753.151217:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5822:1873946311989888:192.168.202.36@tcp:105: 00010000:00010000:0.0:1787134753.151245:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134753.151326:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287849856:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 9103us (10122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.151338:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00010000:00010000:3.0:1787134753.217364:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134753.329680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.329753:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287850240 00000100:00100000:2.0:1787134753.329762:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287850240 00000100:00100000:2.0:1787134753.330022:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 97 00000100:00100000:2.0:1787134753.330044:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+34:10532:x1873946287850240:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134753.330074:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134753.330109:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9064f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070400 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.330220:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9064fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.330234:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9064fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.330263:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9064fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134753.330338:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787134753.330342:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134753.330405:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9064fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.330436:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9064f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070400 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.330471:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9064fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070400 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.330480:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134753.330484:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787134753.330498:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97200, rc 0) 00000100:00100000:2.0:1787134753.330575:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+35:10532:x1873946287850240:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 544us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.330583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 97 00000100:00100000:2.0:1787134753.350921:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.351203:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287850496 00000100:00100000:0.0:1787134753.351214:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287850496 00000100:00100000:0.0:1787134753.351283:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:0.0:1787134753.351294:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+35:10532:x1873946287850496:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134753.351315:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134753.351338:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070407 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.351460:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.351477:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.351511:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134753.351524:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787134753.351658:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070407 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.351679:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070407 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.351688:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa50adee00) 00010000:00010000:0.0:1787134753.351691:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134753.351695:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450600, rc 0) 00000100:00100000:0.0:1787134753.351761:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+37:10532:x1873946287850496:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 469us (851us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787134753.351768:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:1.0:1787134753.358378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134753.358580:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.358669:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287850880 00000100:00100000:0.0:1787134753.358681:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287850880 00000100:00100000:0.0:1787134753.358742:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00100000:0.0:1787134753.358751:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+37:10532:x1873946287850880:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134753.358777:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134753.358806:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906517 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907040e expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.358916:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90651e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.358947:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90651e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.358960:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90651e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134753.358975:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787134753.359109:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906517 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907040e expref: 40 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.359129:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90651e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907040e expref: 39 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.359139:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa50adee00) 00010000:00010000:0.0:1787134753.359141:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787134753.359145:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450c00, rc 0) 00000100:00100000:0.0:1787134753.359247:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+39:10532:x1873946287850880:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 496us (666us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787134753.359254:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00100000:2.0:1787134753.359962:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287850624 00000100:00100000:2.0:1787134753.359969:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287850624 00000100:00100000:2.0:1787134753.360032:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:2.0:1787134753.360042:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+39:2351:x1873946287850624:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134753.360058:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134753.360077:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070407 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.360099:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa50adee00) 00010000:00010000:2.0:1787134753.360103:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134753.360143:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+38:2351:x1873946287850624:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 103us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.360150:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787134753.366546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134753.366677:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287851008 00000100:00100000:1.0:1787134753.366688:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287851008 00000100:00100000:1.0:1787134753.366751:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:1.0:1787134753.366762:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+8:2352:x1873946287851008:12345-192.168.202.36@tcp:1:lfs.0 00010000:00010000:1.0:1787134753.366832:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.366879:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.366888:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134753.366893:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134753.366898:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.366933:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.366949:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 8 pid: 6682 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134753.366978:0:6680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1873946311990016:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134753.367091:0:6680:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa455f83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134753.369334:0:6680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1873946311990016:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134753.369362:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134753.370318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.371349:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287851136 00000100:00100000:0.0:1787134753.371362:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287851136 00002000:00100000:0.0:1787134753.371425:0:6688:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98aa7ae49500 x1873946287851136/t0(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:689/0 lens 504/0 e 0 to 0 dl 1787134764 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787134753.371436:0:6688:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa7ae49500 with x1873946287851136 ext(0->8) 00010000:00010000:0.0:1787134753.371446:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 9 pid: 6682 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.371482:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 9 pid: 6682 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787134753.371490:0:6688:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98aa7ae49500 00000100:00100000:0.0:1787134753.371534:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:0.0:1787134753.371543:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486fb1ad-4266-4864-b299-111c5140734b+9:2351:x1873946287851136:12345-192.168.202.36@tcp:4:lfs.0 00000100:00100000:0.0:1787134753.372745:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486fb1ad-4266-4864-b299-111c5140734b+11:2351:x1873946287851136:12345-192.168.202.36@tcp:4:lfs.0 Request processed in 1196us (2425us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787134753.372756:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00002000:00100000:0.0:1787134753.372776:0:6688:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98aa7ae49500 x1873946287851136/t4294967302(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:689/0 lens 504/448 e 0 to 0 dl 1787134764 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787134753.375961:0:6688:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa7ae49500 with x1873946287851136 ext(0->8) 00010000:00010000:0.0:1787134753.375979:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 11 pid: 6682 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.376641:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 11 pid: 6682 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787134753.376714:0:6688:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98aa7ae49500 00000100:00100000:1.0:1787134753.384532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.384680:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287851264 00000100:00100000:2.0:1787134753.384692:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287851264 00010000:00010000:2.0:1787134753.384737:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 11 pid: 6682 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134753.384775:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:2.0:1787134753.384787:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+11:2349:x1873946287851264:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134753.384814:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787134753.384834:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787134753.384846:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787134753 00002000:00010000:2.0:1787134753.384848:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787134753 00002000:00010000:2.0:1787134753.384850:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787134753 00010000:00010000:2.0:1787134753.384857:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 11 pid: 6682 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.384871:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 11 pid: 6682 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.384895:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae9064ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703f9 expref: 11 pid: 6682 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.384937:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787134753.384941:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787134753.384948:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.384958:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.384993:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134753.385064:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+10:2349:x1873946287851264:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 279us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.385073:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00010000:00010000:3.0:1787134753.385312:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.385325:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.385357:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.385366:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.385374:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.385380:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134753.385385:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.385409:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.385425:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134753.385432:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc359328/0x69932dacae90652c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134753.385491:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287851008:12345-192.168.202.36@tcp:1:lfs.0 Request processed in 18731us (18956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134753.385500:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:3.0:1787134753.388255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.388399:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287851520 00000100:00100000:0.0:1787134753.388411:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287851520 00000100:00100000:0.0:1787134753.388468:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:0.0:1787134753.388478:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa50e43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+38:10532:x1873946287851520:12345-192.168.202.36@tcp:35:lfs.0 00000004:00010000:0.0:1787134753.388567:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90651e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907040e expref: 38 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787134753.389264:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787134753.389314:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787134753.391998:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787134753.392126:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.392149:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703eb expref: 42 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.392188:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.392232:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703eb expref: 42 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.392250:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703eb expref: 42 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134753.392266:0:5839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1873946311990144:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134753.392361:0:5839:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787134753.395925:0:5839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1873946311990144:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134753.395960:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134753.396920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.397257:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287851648 00000100:00100000:2.0:1787134753.397266:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287851648 00010000:00010000:2.0:1787134753.397307:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703eb expref: 43 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134753.397350:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:2.0:1787134753.397360:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+43:2352:x1873946287851648:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134753.397373:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134753.397381:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703eb expref: 43 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.397394:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703eb expref: 43 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.397432:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9064d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703eb expref: 43 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.397450:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa50adee00) 00010000:00010000:2.0:1787134753.397456:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.397466:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.397474:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.397507:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134753.397692:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.397701:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787134753.397826:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000100:00100000:2.0:1787134753.398698:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+43:2352:x1873946287851648:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 1333us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.398709:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000001:00080000:1.0:1787134753.399103:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787134753.400010:0:5839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81022d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1873946311990272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787134753.400079:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134753.400199:0:5839:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa44fbef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787134753.404303:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311990272 00000100:00100000:3.0:1787134753.404318:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311990272 00000100:00100000:3.0:1787134753.404432:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787134753.404443:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1873946311990272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787134753.404574:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1873946311990272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 133us (4494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134753.404582:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134753.404674:0:5839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81022d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1873946311990272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787134753.405327:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787134753.405438:0:5839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1873946311990400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787134753.405493:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134753.410595:0:5839:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787134753.411650:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311990400 00000100:00100000:1.0:1787134753.411666:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311990400 00000100:00100000:1.0:1787134753.411822:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787134753.411843:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1873946311990400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787134753.412757:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5839:x1873946311990400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 920us (7258us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787134753.412769:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787134753.413032:0:5839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1873946311990400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787134753.413106:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787134753.413288:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.413300:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.413308:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.413314:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134753.413318:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.413327:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.413344:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa50adee00) 00010000:00010000:0.0:1787134753.413347:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787134753.413353:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.413359:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae906533 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787134753.413627:0:5839:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787134753.413801:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787134753.413814:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369380655039ns, next at 370380652589ns, rc = 0 00000001:00080000:0.0:1787134753.413822:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787134753.413873:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa50adee00) 00010000:00010000:0.0:1787134753.413877:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787134753.413884:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90651e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907040e expref: 46 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134753.414103:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa50e43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+45:10532:x1873946287851520:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 25625us (25857us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787134753.414112:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000020:00080000:0.0:1787134753.414117:0:5839:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787134753.416953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.417056:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287851776 00000100:00100000:2.0:1787134753.417069:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287851776 00000100:00100000:2.0:1787134753.417140:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:2.0:1787134753.417151:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+45:10532:x1873946287851776:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134753.417217:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134753.417242:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae90653a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070415 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.417307:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae90653a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070415 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.417345:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae90653a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070415 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.417365:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:2.0:1787134753.417368:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134753.417372:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97800, rc 0) 00000100:00100000:2.0:1787134753.417423:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+46:10532:x1873946287851776:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 275us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.417430:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:1.0:1787134753.423242:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134753.423916:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287852032 00000100:00100000:3.0:1787134753.423928:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287852032 00000100:00100000:0.0:1787134753.424137:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:0.0:1787134753.424149:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+46:10532:x1873946287852032:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134753.424563:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+47:10532:x1873946287852032:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 413us (1327us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787134753.424572:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:3.0:1787134753.498868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134753.502443:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287852160 00000100:00100000:1.0:1787134753.502466:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287852160 00000100:00100000:1.0:1787134753.502542:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:1.0:1787134753.502553:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+47:10542:x1873946287852160:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:1.0:1787134753.502655:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502676:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502690:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502705:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502712:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502719:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502810:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502818:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502825:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134753.502880:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502894:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502910:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502917:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.502923:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134753.502928:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.503915:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504004:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134753.504008:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134753.504014:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504021:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906541 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504039:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504045:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504052:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504058:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134753.504071:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504078:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504086:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa50ade100) 00010000:00010000:1.0:1787134753.504089:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134753.504092:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504099:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906548 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504117:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504123:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504129:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504134:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134753.504137:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504143:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504149:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:1.0:1787134753.504152:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134753.504305:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.504312:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae90654f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134753.504411:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+47:10542:x1873946287852160:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1856us (5552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134753.504421:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:3.0:1787134753.578736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134753.578859:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287852416 00000100:00100000:1.0:1787134753.578873:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287852416 00000100:00100000:1.0:1787134753.578959:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 102 00000100:00100000:1.0:1787134753.578971:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+47:10546:x1873946287852416:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134753.578995:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134753.579020:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906556 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907041c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579108:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579127:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579139:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579155:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579192:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579217:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579348:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae90656b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579357:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae90656b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579365:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae90656b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134753.579375:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787134753.579485:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579493:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579500:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579507:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134753.579511:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579519:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579538:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:1.0:1787134753.579541:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134753.579551:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579558:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae90655d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579571:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579577:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579583:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579589:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134753.579592:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579598:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579604:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa50ade100) 00010000:00010000:1.0:1787134753.579607:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134753.579610:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579616:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579652:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906556 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907041c expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579677:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae90656b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907041c expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.579686:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:1.0:1787134753.579688:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134753.579691:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6200, rc 0) 00000100:00100000:1.0:1787134753.579777:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+49:10546:x1873946287852416:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 809us (1058us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787134753.579784:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 102 00000100:00100000:3.0:1787134753.586579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.586747:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287852544 00000100:00100000:0.0:1787134753.586759:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287852544 00000100:00100000:0.0:1787134753.586852:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 103 00000100:00100000:0.0:1787134753.586864:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+49:10546:x1873946287852544:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:0.0:1787134753.586949:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.586970:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.586983:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.587037:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.587044:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.587052:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.587058:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134753.587062:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.587071:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.587085:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134753.587088:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787134753.587093:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.587099:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906579 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134753.587394:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+49:10546:x1873946287852544:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 532us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.587404:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 103 00000100:00100000:3.0:1787134753.590053:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.590143:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287852800 00000100:00100000:0.0:1787134753.590151:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287852800 00000100:00100000:0.0:1787134753.590228:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:0.0:1787134753.590250:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+49:10546:x1873946287852800:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134753.590494:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+50:10546:x1873946287852800:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 245us (449us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787134753.590502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 28 00000040:00080000:1.0:1787134753.602520:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787134753.602534:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787134753.602575:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787134753.602581:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787134753.667123:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311990656:0@lo:400:kworker.0 00000100:00100000:0.0:1787134753.667243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134753.667311:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134753.667317:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311990784:0@lo:400:kworker.0 00000100:00100000:0.0:1787134753.667341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134753.667388:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311990656 00000100:00100000:0.0:1787134753.667399:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311990656 00000100:00100000:0.0:1787134753.667443:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311990784 00000100:00100000:0.0:1787134753.667446:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311990784 00000100:00100000:0.0:1787134753.667469:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787134753.667479:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311990656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134753.667530:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311990656:12345-0@lo:400:kworker.0 Request processed in 51us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.667538:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787134753.667556:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787134753.667562:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311990784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134753.667589:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946311990784:12345-0@lo:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.667595:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787134753.667631:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946311990784:0@lo:400:kworker.0 00000100:00100000:0.0:1787134753.667641:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311990656:0@lo:400:kworker.0 00000100:00100000:3.0:1787134753.668199:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311990528:0@lo:400:kworker.0 00000100:00100000:3.0:1787134753.668238:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134753.668269:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311991040:0@lo:400:kworker.0 00000100:00100000:3.0:1787134753.668296:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134753.668317:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787134753.668324:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311990912:0@lo:400:kworker.0 00000100:00100000:3.0:1787134753.668347:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787134753.668504:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134753.668693:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311990528 00000100:00100000:2.0:1787134753.668700:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311990528 00000100:00100000:2.0:1787134753.668747:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787134753.668756:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311990528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134753.668807:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946311990528:12345-0@lo:400:kworker.0 Request processed in 54us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.668815:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787134753.669631:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311991040 00000100:00100000:0.0:1787134753.669638:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311991040 00000100:00100000:0.0:1787134753.669691:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787134753.669700:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1873946311991040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134753.669749:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1873946311991040:12345-0@lo:400:kworker.0 Request processed in 51us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.669755:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787134753.669777:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311990912 00000100:00100000:0.0:1787134753.669780:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311990912 00000100:00100000:0.0:1787134753.669825:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787134753.669842:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311990912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134753.669872:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946311990912:12345-0@lo:400:kworker.0 Request processed in 41us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.669878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1787134753.670050:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787134753.670055:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134753.670920:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946311990912:0@lo:400:kworker.0 00000100:00100000:3.0:1787134753.670935:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946311990528:0@lo:400:kworker.0 00000100:00100000:3.0:1787134753.670945:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311991040:0@lo:400:kworker.0 00000100:00100000:0.0:1787134753.726850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.731507:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287853056 00000100:00100000:2.0:1787134753.731523:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287853056 00000100:00100000:2.0:1787134753.731592:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00100000:2.0:1787134753.731602:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+50:10556:x1873946287853056:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134753.731629:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134753.731632:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787134753.731664:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9064fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070400 expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.731707:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134753.731712:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134753.731725:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906580 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070423 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.732119:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.732136:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.732147:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134753.732204:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787134753.732347:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906580 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070423 expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.732363:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070423 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.732372:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:2.0:1787134753.732375:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134753.732378:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96c00, rc 0) 00000100:00100000:2.0:1787134753.732568:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+51:10556:x1873946287853056:12345-192.168.202.36@tcp:101:bash.0 Request processed in 965us (5733us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787134753.732576:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 104 00000001:00080000:3.0:1787134753.733136:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1787134753.733178:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1787134753.734239:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1787134753.743443:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.743548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287853312 00000100:00100000:2.0:1787134753.743557:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287853312 00000100:00100000:2.0:1787134753.743622:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 105 00000100:00100000:2.0:1787134753.743631:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+51:10556:x1873946287853312:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:2.0:1787134753.743696:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787134753.743728:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070423 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.743754:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae90656b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907041c expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.743765:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:2.0:1787134753.743769:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134753.744030:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.744043:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.744052:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787134753.744096:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787134753.744118:0:5837:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000490581c1 reply state 00000000db247fb7 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134753.744126:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134753.744233:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+52:10556:x1873946287853312:12345-192.168.202.36@tcp:36:bash.0 Request processed in 602us (805us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787134753.744240:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 105 00000020:00080000:2.0:1787134753.744256:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787134753.747593:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.747611:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.747619:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.747625:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134753.747632:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.747640:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.747675:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134753.747678:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134753.747683:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.747689:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906595 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134753.752518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.752598:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287853440 00000100:00100000:0.0:1787134753.752609:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287853440 00000100:00100000:0.0:1787134753.752669:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 106 00000100:00100000:0.0:1787134753.752678:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+51:10556:x1873946287853440:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787134753.752704:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134753.752734:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90659c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907042a expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.752817:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.752841:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.752853:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134753.752879:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787134753.752883:0:11472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134753.752911:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.752955:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae90659c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907042a expref: 53 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.752974:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907042a expref: 52 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.752983:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134753.752986:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134753.752990:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451800, rc 0) 00000100:00100000:0.0:1787134753.753056:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+52:10556:x1873946287853440:12345-192.168.202.36@tcp:101:bash.0 Request processed in 378us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.753063:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 106 00000100:00100000:3.0:1787134753.758944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.759021:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287853696 00000100:00100000:0.0:1787134753.759031:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287853696 00000100:00100000:0.0:1787134753.759092:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:0.0:1787134753.759103:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+52:10556:x1873946287853696:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:0.0:1787134753.759424:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+53:10556:x1873946287853696:12345-192.168.202.36@tcp:35:bash.0 Request processed in 322us (490us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787134753.759434:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:1.0:1787134753.908124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.908268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287853824 00000100:00100000:2.0:1787134753.908280:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287853824 00000100:00100000:2.0:1787134753.908397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 107 00000100:00100000:2.0:1787134753.908410:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+53:10562:x1873946287853824:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134753.908435:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134753.908457:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9065aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070431 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.908577:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9065b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.908593:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9065b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.908605:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9065b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134753.908669:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787134753.908673:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134753.908698:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9065b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.908725:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9065aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070431 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.908745:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9065b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070431 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.908754:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134753.908772:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787134753.908776:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96e00, rc 0) 00000100:00100000:2.0:1787134753.908861:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+54:10562:x1873946287853824:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 454us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.908873:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 107 00000100:00100000:3.0:1787134753.917486:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.917565:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287853952 00000100:00100000:0.0:1787134753.917577:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287853952 00000100:00100000:0.0:1787134753.917634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00100000:0.0:1787134753.917644:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+54:10562:x1873946287853952:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134753.917664:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134753.917684:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070438 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.917774:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.917791:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.917805:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.917822:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.917829:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.917846:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.917968:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9065cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.917976:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9065cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.917983:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9065cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134753.918022:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787134753.918026:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134753.918045:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9065cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918069:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9065cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918078:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918086:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918092:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918098:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134753.918103:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918110:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918123:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:0.0:1787134753.918126:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134753.918130:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918136:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9065bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918151:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918192:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918205:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918210:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134753.918213:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918220:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918229:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa44db2f00) 00010000:00010000:0.0:1787134753.918231:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134753.918234:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918240:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918274:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070438 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918289:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9065cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070438 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.918296:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134753.918299:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134753.918301:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451400, rc 0) 00000100:00100000:0.0:1787134753.919988:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+55:10562:x1873946287853952:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 2339us (2730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.920012:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00100000:1.0:1787134753.927455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.927596:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287854080 00000100:00100000:2.0:1787134753.927609:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287854080 00000100:00100000:2.0:1787134753.927695:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:2.0:1787134753.927708:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+55:2351:x1873946287854080:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134753.927735:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134753.927772:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9065cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070438 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.927799:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:2.0:1787134753.927805:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134753.927882:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+54:2351:x1873946287854080:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 177us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.927889:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:1.0:1787134753.933245:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.933441:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287854336 00000100:00100000:2.0:1787134753.933455:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287854336 00000100:00100000:2.0:1787134753.933527:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 109 00000100:00100000:2.0:1787134753.933538:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+54:10562:x1873946287854336:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134753.933562:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134753.933585:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9065d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907043f expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.933689:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.933719:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907042a expref: 55 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.933729:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.933819:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907042a expref: 55 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.933844:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907042a expref: 55 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134753.933860:0:11683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd95500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1873946311991168:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134753.933967:0:11683:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5075bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134753.946697:0:11683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd95500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1873946311991168:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134753.946749:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134753.947644:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.947945:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287854464 00000100:00100000:0.0:1787134753.947954:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287854464 00010000:00010000:0.0:1787134753.948000:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907042a expref: 56 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134753.948045:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:0.0:1787134753.948055:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+56:2352:x1873946287854464:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134753.948070:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134753.948078:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907042a expref: 56 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.948091:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907042a expref: 56 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.948117:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907042a expref: 56 pid: 11472 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.948133:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134753.948138:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.948147:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.948155:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.948250:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134753.948299:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+55:2352:x1873946287854464:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 246us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.948307:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00010000:00010000:1.0:1787134753.948742:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.948752:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134753.948775:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787134753.948961:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9065d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907043f expref: 56 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.948996:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907043f expref: 55 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134753.949005:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:1.0:1787134753.949008:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787134753.949010:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97200, rc 0) 00000100:00100000:1.0:1787134753.949050:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+55:10562:x1873946287854336:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 15514us (15817us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787134753.949057:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 109 00000100:00100000:1.0:1787134753.960075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.960574:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287854720 00000100:00100000:2.0:1787134753.960631:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287854720 00000100:00100000:2.0:1787134753.960731:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:2.0:1787134753.960745:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81023b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+55:10562:x1873946287854720:12345-192.168.202.36@tcp:103:lfs.0 00010000:00010000:2.0:1787134753.960768:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134753.960807:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae90653a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070415 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.960962:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:2.0:1787134753.960968:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134753.961047:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81023b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+54:10562:x1873946287854720:12345-192.168.202.36@tcp:103:lfs.0 Request processed in 305us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.961057:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:1.0:1787134753.966420:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134753.967027:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287854848 00000100:00100000:2.0:1787134753.967040:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287854848 00000100:00100000:2.0:1787134753.967128:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 110 00000100:00100000:2.0:1787134753.967140:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+54:10562:x1873946287854848:12345-192.168.202.36@tcp:58:lfs.0 00010000:00010000:2.0:1787134753.967335:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.967357:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134753.967373:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787134753.967872:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787134753.968113:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+54:10562:x1873946287854848:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 972us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134753.968121:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 110 00000100:00100000:1.0:1787134753.974247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134753.974381:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287854976 00000100:00100000:0.0:1787134753.974394:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287854976 00000100:00100000:0.0:1787134753.974637:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 111 00000100:00100000:0.0:1787134753.974649:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+54:10562:x1873946287854976:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134753.974673:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134753.974695:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070446 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.974766:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.974780:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065f0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070446 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.974807:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.974821:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065f0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070446 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.974860:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134753.974864:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787134753.974868:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065f0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070446 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134753.974895:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451800, rc 0) 00000100:00100000:0.0:1787134753.975155:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+55:10562:x1873946287854976:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 509us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134753.975194:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 111 00000004:00080000:1.0:1787134754.177189:0:7838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370144027057ns, next at 371144024195ns, rc = 0 00000100:00100000:0.0:1787134754.177737:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4daf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311991296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134754.177816:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134754.178193:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311991296 00000100:00100000:1.0:1787134754.178202:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311991296 00000100:00100000:1.0:1787134754.178261:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787134754.178271:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946311991296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134754.178307:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134754.178365:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946311991296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134754.178374:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787134754.178553:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4daf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311991296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787134754.240409:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134754.571921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134754.571971:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134754.572001:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134754.572053:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134754.572087:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287855488 00000100:00100000:1.0:1787134754.572098:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287855488 00000100:00100000:1.0:1787134754.572194:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 156 00000100:00100000:1.0:1787134754.572205:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287855488:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134754.572294:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287855488:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134754.572302:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 156 00000100:00080000:1.0:1787134754.572326:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134754.572515:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287855104 00000100:00100000:2.0:1787134754.572520:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287855104 00000100:00100000:2.0:1787134754.572563:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 294 00000100:00100000:2.0:1787134754.572571:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287855104:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134754.572609:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287855104:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 39us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134754.572616:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 294 00000100:00100000:0.0:1787134754.572752:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287855360 00000100:00100000:0.0:1787134754.572756:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287855360 00000100:00100000:0.0:1787134754.572794:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287855232 00000100:00100000:0.0:1787134754.572797:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287855232 00000100:00100000:0.0:1787134754.572816:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:0.0:1787134754.572822:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+8:2350:x1873946287855360:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134754.572860:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+8:2350:x1873946287855360:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 38us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134754.572867:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:0.0:1787134754.572878:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:0.0:1787134754.572884:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2350:x1873946287855232:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134754.572906:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2350:x1873946287855232:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 23us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134754.572913:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00080000:2.0:1787134754.573509:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1787134754.625781:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787134754.625791:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787134754.625859:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787134754.625877:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787134754.626020:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946311991424:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787134754.626150:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa47fb7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787134754.637340:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946311991424:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787134754.645270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134754.645363:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287855616 00000100:00100000:2.0:1787134754.645375:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287855616 00000100:00100000:2.0:1787134754.645475:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 112 00000100:00100000:2.0:1787134754.645487:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+55:10563:x1873946287855616:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787134754.645521:0:5836:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787134754.645655:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+55:10563:x1873946287855616:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 170us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134754.645662:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 112 00000100:00080000:1.0:1787134754.647660:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134754.662846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134754.663582:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287855744 00000100:00100000:0.0:1787134754.663593:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287855744 00000100:00100000:0.0:1787134754.663666:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 113 00000100:00100000:0.0:1787134754.663676:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+55:10563:x1873946287855744:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787134754.663763:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.663792:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.663804:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.663872:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.663887:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.663894:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.663917:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.663926:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.663932:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134754.663971:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787134754.663976:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134754.663988:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664005:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664012:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664018:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664034:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134754.664039:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664047:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664059:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:0.0:1787134754.664062:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134754.664067:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664072:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9065f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664086:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664092:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664098:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664108:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134754.664111:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664117:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664124:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff98aa44db2f00) 00010000:00010000:0.0:1787134754.664126:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134754.664129:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664134:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9065fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664147:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664152:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664206:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664211:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134754.664214:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664220:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664237:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134754.664239:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134754.664242:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.664247:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134754.664323:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+55:10563:x1873946287855744:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 648us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134754.664331:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 113 00000100:00100000:3.0:1787134754.677102:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134754.683392:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287856000 00000100:00100000:0.0:1787134754.683415:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287856000 00000100:00100000:0.0:1787134754.683509:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00100000:0.0:1787134754.683520:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+55:10563:x1873946287856000:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134754.683541:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134754.683564:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae90660c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907044d expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.683685:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.683702:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.683715:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134754.683728:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787134754.684216:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.684226:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.684234:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.684241:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134754.684246:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.684253:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.684269:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134754.684272:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787134754.684277:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.684284:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae906613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.684328:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae90660c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907044d expref: 57 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.684339:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:0.0:1787134754.684342:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787134754.684346:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae90660c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907044d expref: 57 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.684370:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450e00, rc 0) 00000100:00100000:0.0:1787134754.684466:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+56:10563:x1873946287856000:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 948us (7378us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787134754.684474:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00100000:1.0:1787134754.693140:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134754.693608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287856128 00000100:00100000:3.0:1787134754.693620:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287856128 00000100:00100000:3.0:1787134754.693686:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:3.0:1787134754.693697:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+56:10563:x1873946287856128:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787134754.693748:0:5837:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787134754.698256:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+56:10563:x1873946287856128:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 183us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134754.698293:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:1.0:1787134754.703197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134754.703339:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287856384 00000100:00100000:2.0:1787134754.703351:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287856384 00000100:00100000:2.0:1787134754.703407:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:2.0:1787134754.703431:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+56:10563:x1873946287856384:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134754.703459:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134754.703463:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787134754.703493:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9065b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070431 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.703513:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134754.703518:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134754.703532:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906621 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070454 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787134754.705639:0:11683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787134754.707143:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906628 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.707192:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.707205:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.707275:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906621 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070454 expref: 58 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.707294:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906628 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070454 expref: 57 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.707302:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:2.0:1787134754.707304:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134754.707307:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97400, rc 0) 00000100:00100000:2.0:1787134754.707383:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+57:10563:x1873946287856384:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 3965us (4225us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787134754.707393:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:1.0:1787134754.715317:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134754.717259:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287856640 00000100:00100000:2.0:1787134754.717278:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287856640 00000100:00100000:2.0:1787134754.717368:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:2.0:1787134754.717382:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+57:10563:x1873946287856640:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787134754.717469:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134754.717521:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906628 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070454 expref: 57 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.717545:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:2.0:1787134754.717558:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134754.717589:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.717603:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.717613:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.717669:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.717677:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.717685:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718289:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718300:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718307:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718312:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134754.718325:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718333:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718343:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134754.718345:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134754.718348:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718354:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906636 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718367:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718373:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718378:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718383:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134754.718386:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718392:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718399:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xfd71d4ef (ffff98aa59e99e00) 00010000:00010000:2.0:1787134754.718401:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134754.718410:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.718429:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae90663d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfd71d4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134754.723067:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+56:10563:x1873946287856640:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 5674us (7747us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787134754.723081:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:1.0:1787134754.734271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134754.734398:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287856768 00000100:00100000:3.0:1787134754.734411:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287856768 00000100:00100000:3.0:1787134754.734482:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:3.0:1787134754.734492:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+56:10563:x1873946287856768:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134754.734514:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134754.734538:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906644 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907045b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.734577:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.734592:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.734605:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.734721:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906644 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907045b expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.734741:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907045b expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.734749:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:3.0:1787134754.734758:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787134754.734762:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a400, rc 0) 00000100:00100000:3.0:1787134754.734845:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+57:10563:x1873946287856768:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 354us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134754.734853:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:1.0:1787134754.741865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134754.743652:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287857024 00000100:00100000:2.0:1787134754.743666:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287857024 00000100:00100000:3.0:1787134754.744387:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:3.0:1787134754.744400:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+57:10563:x1873946287857024:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787134754.744511:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.744530:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.744542:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787134754.744856:0:11683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1787134754.744978:0:11683:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000ac506379 reply state 000000002e251f86 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134754.744988:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787134754.745435:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+59:10563:x1873946287857024:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 1034us (3575us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787134754.745444:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:1.0:1787134754.750807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134754.751382:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287857152 00000100:00100000:2.0:1787134754.751396:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287857152 00000100:00100000:2.0:1787134754.751473:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:2.0:1787134754.751485:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+59:10563:x1873946287857152:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134754.751509:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134754.751530:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070462 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.751588:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070462 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.751604:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070462 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134754.751624:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:2.0:1787134754.751628:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134754.751632:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96400, rc 0) 00000100:00100000:2.0:1787134754.756787:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+60:10563:x1873946287857152:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 5273us (5959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134754.756836:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 120 00010000:00010000:3.0:1787134754.759198:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.759217:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.759245:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.759251:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134754.759256:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.759265:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.759282:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:3.0:1787134754.759286:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787134754.759291:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.759298:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906652 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134754.766899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134754.767321:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287857280 00000100:00100000:0.0:1787134754.767332:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287857280 00000100:00100000:0.0:1787134754.767388:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:0.0:1787134754.767402:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+8:2350:x1873946287857280:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787134754.768361:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+9:2350:x1873946287857280:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 957us (1481us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787134754.768372:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:0.0:1787134754.773533:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134754.773685:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287857536 00000100:00100000:2.0:1787134754.773696:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287857536 00000100:00100000:2.0:1787134754.773791:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:2.0:1787134754.773803:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+59:10563:x1873946287857536:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787134754.774660:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+60:10563:x1873946287857536:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 856us (1133us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787134754.774670:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:2.0:1787134754.778920:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134754.779142:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287857792 00000100:00100000:0.0:1787134754.779152:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287857792 00000100:00100000:0.0:1787134754.779242:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:0.0:1787134754.779253:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+60:10563:x1873946287857792:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787134754.781746:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+60:10563:x1873946287857792:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 2482us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134754.781763:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:1.0:1787134754.788788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134754.789124:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287857920 00000100:00100000:3.0:1787134754.789134:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287857920 00000100:00100000:3.0:1787134754.789235:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:3.0:1787134754.789246:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+60:10563:x1873946287857920:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134754.789269:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134754.789294:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906660 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070469 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.789374:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906667 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.789408:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.789431:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134754.789475:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787134754.789495:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.789524:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906660 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070469 expref: 62 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.789546:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070469 expref: 61 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.789557:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:3.0:1787134754.789560:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787134754.789564:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b800, rc 0) 00000100:00100000:3.0:1787134754.789638:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+61:10563:x1873946287857920:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 394us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134754.789645:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:1.0:1787134754.797446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134754.797600:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287858048 00000100:00100000:0.0:1787134754.797611:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287858048 00000100:00100000:0.0:1787134754.797674:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:0.0:1787134754.797684:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+9:2350:x1873946287858048:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134754.797707:0:7839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134754.797754:0:7839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070470 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787134754.797793:0:7839:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a858323, blocks: 0x1 00010000:00010000:0.0:1787134754.797814:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:0.0:1787134754.797818:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134754.797837:0:7839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070470 expref: 10 pid: 7839 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.797855:0:7839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070470 expref: 10 pid: 7839 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.797870:0:7839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450200, rc 0) 00000100:00100000:0.0:1787134754.798379:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+10:2350:x1873946287858048:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 694us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134754.798388:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:2.0:1787134754.811295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134754.811488:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287858304 00000100:00100000:0.0:1787134754.811498:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287858304 00000100:00100000:0.0:1787134754.811610:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:0.0:1787134754.811622:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+61:10563:x1873946287858304:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787134754.811777:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+61:10563:x1873946287858304:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 146us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134754.811785:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:2.0:1787134754.815819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134754.816123:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287858432 00000100:00100000:3.0:1787134754.816134:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287858432 00000100:00100000:3.0:1787134754.816232:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:3.0:1787134754.816242:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+10:10563:x1873946287858432:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134754.816260:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134754.816293:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070477 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.816325:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070470 expref: 11 pid: 7839 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.816333:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134754.816338:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134754.816343:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.816377:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070470 expref: 11 pid: 7839 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.816392:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070470 expref: 11 pid: 7839 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134754.816407:0:6680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7ae48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1873946311991552:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134754.816494:0:6680:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787134754.820907:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134754.821068:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287858560 00000100:00100000:0.0:1787134754.821078:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287858560 00010000:00010000:0.0:1787134754.821131:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070470 expref: 12 pid: 7839 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134754.821223:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:0.0:1787134754.821233:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+12:2351:x1873946287858560:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134754.821248:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134754.821270:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070470 expref: 12 pid: 7839 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.821284:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070470 expref: 12 pid: 7839 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.821309:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134754.821314:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134754.821322:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.821332:0:7620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134754.821368:0:7620:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134754.821382:0:7620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7620:1873946311991680:192.168.202.36@tcp:105: 00000100:00100000:0.0:1787134754.821482:0:7620:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4133a840 going to sleep for 11 seconds 00010000:00010000:3.0:1787134754.822378:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cb42b37/0x69932dacae90666e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070470 expref: 12 pid: 7839 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134754.822399:0:6680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7ae48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1873946311991552:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134754.822503:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134754.822536:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a200, rc 0) 00000100:00100000:3.0:1787134754.822595:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+11:10563:x1873946287858432:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 6354us (6788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134754.822605:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:2.0:1787134754.839415:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134754.839512:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287858688 00000100:00100000:1.0:1787134754.839538:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287858688 00002000:00100000:1.0:1787134754.839591:0:6687:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98aa6fd97480 x1873946287858688/t0(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:690/0 lens 504/0 e 0 to 0 dl 1787134765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787134754.839602:0:6687:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa6fd97480 with x1873946287858688 ext(0->12) 00002000:00010000:1.0:1787134754.839608:0:6687:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa6fd97480 00000100:00100000:1.0:1787134754.839646:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:1.0:1787134754.839656:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486fb1ad-4266-4864-b299-111c5140734b+11:2351:x1873946287858688:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787134754.840432:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486fb1ad-4266-4864-b299-111c5140734b+13:2351:x1873946287858688:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 Request processed in 773us (1025us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787134754.840442:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00002000:00100000:1.0:1787134754.840451:0:6687:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98aa6fd97480 x1873946287858688/t4294967308(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:690/0 lens 504/448 e 0 to 0 dl 1787134765 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787134754.840460:0:6687:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa6fd97480 with x1873946287858688 ext(0->12) 00002000:00010000:1.0:1787134754.840465:0:6687:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa6fd97480 00000100:00100000:0.0:1787134754.842570:0:7620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7620:1873946311991680:192.168.202.36@tcp:105: 00010000:00010000:0.0:1787134754.842645:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134754.842731:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+12:2351:x1873946287858560:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 21498us (21841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134754.842744:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:2.0:1787134754.851316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134754.852713:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287858816 00000100:00100000:0.0:1787134754.852732:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287858816 00000100:00100000:0.0:1787134754.852833:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 124 00000100:00100000:0.0:1787134754.852845:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+61:10563:x1873946287858816:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787134755.021662:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+61:10563:x1873946287858816:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 168808us (170343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134755.021677:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 124 00000001:00080000:1.0:1787134755.022832:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:1.0:1787134755.022860:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787134755.022887:0:5858:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98a9437b8a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787134755.022892:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa52a47700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98a9437b8000 00000020:00080000:1.0:1787134755.022895:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa52a47c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98aa6fe6dc00 00000004:00080000:1.0:1787134755.022937:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1787134755.023236:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134755.023271:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311991808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787134755.023348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134755.023431:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311991808 00000100:00100000:0.0:1787134755.023441:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311991808 00000100:00100000:0.0:1787134755.023506:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787134755.023516:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311991808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787134755.023544:0:6681:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1787134755.023580:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a858321, atime: 0x6a858321, ctime: 0x6a858321, blocks: 0xb 00010000:00010000:0.0:1787134755.023589:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.023621:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:0.0:1787134755.023626:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134755.023634:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.023670:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.023682:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.023691:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.023722:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787134755.027857:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946311991808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4334us (4500us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787134755.027871:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787134755.027913:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787134755.027931:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134755.027939:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.027951:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134755.027955:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.027966:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.028001:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.028009:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075b9cd57/0x69932dacae90667c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.028035:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134755.028037:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134755.028039:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787134755.028138:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787134755.028627:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787134755.028634:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1787134755.028689:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98aa52a70700, transno 4294967301 00000004:00080000:3.0:1787134755.028714:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1787134755.028748:0:3307:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff98aa819e6680 x1873946311991808/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787134771 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787134755.028782:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa819e6680/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787134755.028801:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311991808:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787134755.029807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000001:00080000:1.0:1787134755.030005:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787134755.030022:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787134755.030034:0:5858:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98aa508860c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787134755.030038:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa51a45100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98aa462a4300 00000020:00080000:1.0:1787134755.030058:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa51a45200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98aa524f2400 00000020:00080000:1.0:1787134755.030095:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787134755.030340:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787134755.032317:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134755.032341:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311991936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787134755.032433:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134755.032498:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287858944 00000100:00100000:2.0:1787134755.032505:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287858944 00000100:00100000:2.0:1787134755.032551:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311991936 00000100:00100000:2.0:1787134755.032554:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311991936 00000100:00100000:2.0:1787134755.032591:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:2.0:1787134755.032602:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+12:2352:x1873946287858944:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787134755.032692:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787134755.032700:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1873946311991936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787134755.032715:0:6680:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787134755.032742:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.032764:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703d6 expref: 12 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.032774:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787134755.032779:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787134755.032784:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.032814:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703d6 expref: 12 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.032844:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703d6 expref: 12 pid: 11954 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134755.032856:0:6680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1873946311992064:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134755.032922:0:6680:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81454a80 going to sleep for 11 seconds 00000100:00080000:0.0:1787134755.036572:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787134755.056553:0:6680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1873946311992064:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134755.056584:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134755.067616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134755.067939:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287859072 00000100:00100000:3.0:1787134755.067949:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287859072 00010000:00010000:3.0:1787134755.067990:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703d6 expref: 13 pid: 11954 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134755.068034:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:3.0:1787134755.068044:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+13:2352:x1873946287859072:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134755.068059:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134755.068065:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703d6 expref: 13 pid: 11954 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.068081:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703d6 expref: 13 pid: 11954 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.068122:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aae1699a/0x69932dacae90643e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90703d6 expref: 13 pid: 11954 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.068138:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1787134755.068143:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787134755.068150:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.068199:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.068224:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134755.068271:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+12:2352:x1873946287859072:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 228us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134755.068279:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 54 00010000:00010000:2.0:1787134755.068495:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.068507:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.068518:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.068526:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.068551:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787134755.069229:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1873946311991936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36527us (36794us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787134755.069237:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1787134755.069361:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134755.069370:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.069380:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134755.069385:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.069398:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.069417:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.069424:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb70604e/0x69932dacae906683 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.069460:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134755.069462:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134755.069464:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787134755.070197:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa6fd96d80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787134755.070216:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311991936:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787134755.124265:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1787134755.124293:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1787134755.124306:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1787134755.135017:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287858944:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 102398us (105201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134755.135037:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:2.0:1787134755.139803:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134755.140014:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287859328 00000100:00100000:0.0:1787134755.140054:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287859328 00000100:00100000:0.0:1787134755.140303:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:0.0:1787134755.140315:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+15:10563:x1873946287859328:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787134755.140397:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134755.140433:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906667 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070469 expref: 15 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.140455:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:0.0:1787134755.140460:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787134755.140494:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.140509:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.140520:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787134755.141986:0:5837:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000003c8313a1 reply state 00000000b0d6b6d9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134755.142003:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134755.142136:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+16:10563:x1873946287859328:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 1821us (2341us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787134755.142144:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:0.0:1787134755.162979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00010000:00010000:1.0:1787134755.163071:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.163088:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.163096:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.163102:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134755.163107:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.163117:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.163141:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:1.0:1787134755.163145:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134755.163151:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.163188:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90668a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134755.167448:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287859456 00000100:00100000:3.0:1787134755.167468:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287859456 00000100:00100000:3.0:1787134755.167551:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:3.0:1787134755.167571:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287859456:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787134755.167817:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787134755.167830:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787134754 00002000:00010000:3.0:1787134755.167832:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787134753 00002000:00010000:3.0:1787134755.167835:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787134755 -> 1787134754 00002000:00010000:3.0:1787134755.167837:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787134755.167905:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2352:x1873946287859456:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 336us (4941us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787134755.167912:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:1.0:1787134755.175093:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134755.175197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287859712 00000100:00100000:0.0:1787134755.175208:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287859712 00000100:00100000:0.0:1787134755.175299:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 126 00000100:00100000:0.0:1787134755.175310:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+15:10563:x1873946287859712:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787134755.175394:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.175415:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907045b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.175425:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.175461:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907045b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.175478:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907045b expref: 15 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.175493:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311992192:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134755.179152:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54b7fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787134755.187918:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134755.188014:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287859840 00000100:00100000:1.0:1787134755.188025:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287859840 00010000:00010000:1.0:1787134755.188071:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907045b expref: 16 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134755.188131:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:1.0:1787134755.188142:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+16:2352:x1873946287859840:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134755.188198:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134755.188209:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907045b expref: 16 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.188222:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907045b expref: 16 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.188544:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:1.0:1787134755.188551:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.188572:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.188580:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.188601:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134755.188667:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+16:2352:x1873946287859840:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 526us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134755.188676:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 55 00010000:00010000:0.0:1787134755.189001:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90664b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907045b expref: 15 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.189020:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311992192:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134755.189044:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.189053:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.189072:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.189102:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.189109:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.189115:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.189121:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134755.189125:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.189133:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.189144:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:0.0:1787134755.189147:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787134755.189151:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.189195:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906691 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.190584:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+14:10563:x1873946287859712:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 Request processed in 15264us (15491us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787134755.190607:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 126 00000100:00100000:2.0:1787134755.199930:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134755.200034:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287859968 00000100:00100000:0.0:1787134755.200046:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287859968 00000100:00100000:0.0:1787134755.200108:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:0.0:1787134755.200119:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:2352:x1873946287859968:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787134755.200198:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.200219:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.200228:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787134755.200232:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787134755.200238:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.200282:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.200297:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 7 pid: 6680 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.200312:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1873946311992320:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134755.200390:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54b7fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787134755.207917:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1873946311992320:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134755.207971:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134755.210144:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134755.210555:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287860096 00000100:00100000:3.0:1787134755.210565:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287860096 00010000:00010000:3.0:1787134755.210610:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 8 pid: 6680 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134755.210652:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:3.0:1787134755.210661:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287860096:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134755.210677:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134755.210699:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 8 pid: 6680 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.210876:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 8 pid: 6680 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.210904:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf026d2/0x69932dacae906675 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070477 expref: 8 pid: 6680 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.210922:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787134755.210940:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787134755.210947:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.210958:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.210995:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134755.211061:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287860096:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 400us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134755.211069:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00010000:00010000:0.0:1787134755.211130:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.211140:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.211191:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.211200:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.211208:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.211215:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451e00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134755.211220:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.211229:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.211251:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.211272:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df354bc5/0x69932dacae906698 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.211321:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287859968:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 11204us (11401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134755.211330:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:2.0:1787134755.228304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134755.228484:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287860352 00000100:00100000:0.0:1787134755.228496:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287860352 00000100:00100000:0.0:1787134755.228568:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 127 00000100:00100000:0.0:1787134755.228579:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+14:10563:x1873946287860352:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787134755.228676:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.228710:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.228725:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.228998:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.229010:0:11472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070462 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.229018:0:11472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.229074:0:11472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070462 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.229089:0:11472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070462 expref: 15 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.229105:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311992448:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134755.229224:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54b7fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134755.232596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134755.232764:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287860480 00000100:00100000:3.0:1787134755.232782:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287860480 00010000:00010000:3.0:1787134755.232833:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070462 expref: 16 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134755.232878:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:3.0:1787134755.232891:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+16:2352:x1873946287860480:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134755.232909:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134755.232918:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070462 expref: 16 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.232933:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070462 expref: 16 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.232970:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:3.0:1787134755.232977:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.233002:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.233012:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.233033:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134755.233099:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+16:2352:x1873946287860480:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 209us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134755.233106:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 57 00010000:00010000:0.0:1787134755.233297:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906659 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070462 expref: 15 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.233318:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311992448:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134755.233344:0:11472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.233354:0:11472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.233360:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787134755.233581:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787134755.233880:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787134755.233926:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787134755.235339:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946311992576:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787134755.235403:0:11472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134755.235433:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5023d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787134755.237541:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311992576 00000100:00100000:3.0:1787134755.237555:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311992576 00000100:00100000:3.0:1787134755.237637:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787134755.237649:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11472:x1873946311992576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787134755.237765:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11472:x1873946311992576:12345-0@lo:1000:mdt00_003.0 Request processed in 118us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134755.237773:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787134755.237987:0:11472:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787134755.237995:0:11472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1787134755.238022:0:11472:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff98aa6fd96d80 x1873946311991936/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787134771 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134755.238049:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946311992576:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787134755.238616:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787134755.238714:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa52a70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946311992704:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787134755.238762:0:11472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134755.238802:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54b7fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787134755.239929:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311992704 00000100:00100000:2.0:1787134755.239951:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311992704 00000100:00100000:2.0:1787134755.239997:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787134755.240008:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11472:x1873946311992704:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787134755.240297:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11472:x1873946311992704:12345-0@lo:1000:mdt00_003.0 Request processed in 291us (1533us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787134755.240305:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787134755.240697:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa52a70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946311992704:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787134755.240737:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.240749:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.240757:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.240763:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134755.241399:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241412:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241434:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7c900) 00010000:00010000:1.0:1787134755.241437:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787134755.241443:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241449:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9066a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241512:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241518:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241524:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241528:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134755.241531:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241538:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241546:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:1.0:1787134755.241548:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787134755.241556:0:11472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070446 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241568:0:11472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070446 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241577:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070446 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134755.241627:0:11472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070446 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134755.241653:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311992832:192.168.202.36@tcp:105: 00000100:00100000:1.0:1787134755.241739:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5075be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787134755.259033:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6aa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311992832:192.168.202.36@tcp:105: 00010000:00010000:0.0:1787134755.259068:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259080:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae9065e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259119:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259134:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259145:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259197:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259206:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259213:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259219:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134755.259222:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259230:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259251:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134755.259273:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134755.259278:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259284:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259296:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259302:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259308:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259313:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134755.259316:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259322:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259330:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134755.259333:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787134755.259335:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.259341:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90669f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.260690:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+18:10563:x1873946287860352:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 32107us (32391us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787134755.260714:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 127 00000020:00080000:0.0:1787134755.260721:0:11472:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787134755.262151:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787134755.262183:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787134755.263527:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787134755.263541:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787134755.264677:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134755.269791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287860736 00000100:00100000:3.0:1787134755.269808:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287860736 00000100:00100000:3.0:1787134755.269943:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:3.0:1787134755.269956:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+18:10563:x1873946287860736:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787134755.270771:0:5839:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787134755.270895:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787134755.270949:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.270968:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.270988:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.270997:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.271003:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.271009:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134755.271024:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787134755.271124:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+20:10563:x1873946287860736:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1168us (6464us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787134755.271133:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00000020:00080000:3.0:1787134755.271139:0:5839:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787134755.271509:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134755.271932:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287860864 00000100:00100000:0.0:1787134755.271940:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287860864 00000100:00100000:0.0:1787134755.271971:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:0.0:1787134755.271981:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa50e43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+20:10562:x1873946287860864:12345-192.168.202.36@tcp:49:lfs.0 00000100:00100000:0.0:1787134755.272059:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa50e43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+20:10562:x1873946287860864:12345-192.168.202.36@tcp:49:lfs.0 Request processed in 79us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134755.272067:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 32 00010000:00010000:0.0:1787134755.272109:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134755.272116:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.272124:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134755.272129:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.272138:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.272151:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:0.0:1787134755.272154:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787134755.272176:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.272183:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9066b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.272199:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134755.272209:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134755.272210:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134755.272216:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134755.277880:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134755.278015:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287861120 00000100:00100000:2.0:1787134755.278028:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287861120 00000100:00100000:2.0:1787134755.278097:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 128 00000100:00100000:2.0:1787134755.278109:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+20:10562:x1873946287861120:12345-192.168.202.36@tcp:58:lfs.0 00000040:00080000:2.0:1787134755.278448:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787134755.278543:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+20:10562:x1873946287861120:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 436us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134755.278552:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 128 00000100:00100000:2.0:1787134755.343031:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134755.343153:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287861248 00000100:00100000:0.0:1787134755.343225:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287861248 00000100:00100000:0.0:1787134755.343415:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 129 00000100:00100000:0.0:1787134755.343427:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+20:10565:x1873946287861248:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134755.343452:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134755.343474:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907047e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.343556:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.343572:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.343590:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.343753:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.343763:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.343834:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.344146:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.344193:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907043f expref: 21 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.344203:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.344238:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907043f expref: 21 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.346209:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907043f expref: 21 pid: 11683 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.346228:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81022d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311992960:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134755.351108:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5023d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787134755.356040:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134755.358449:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287861504 00000100:00100000:1.0:1787134755.358468:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287861504 00000100:00100000:1.0:1787134755.358544:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:1.0:1787134755.358556:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+22:9250:x1873946287861504:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787134755.358839:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+23:9250:x1873946287861504:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 284us (2808us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787134755.358848:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787134755.360881:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81022d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311992960:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134755.360915:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134755.373956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134755.374126:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287861632 00000100:00100000:0.0:1787134755.374137:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287861632 00010000:00010000:0.0:1787134755.374217:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907043f expref: 23 pid: 11683 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134755.374258:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:0.0:1787134755.374269:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+23:2351:x1873946287861632:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134755.374284:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134755.374292:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907043f expref: 23 pid: 11683 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.374324:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907043f expref: 23 pid: 11683 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.374349:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9065db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907043f expref: 23 pid: 11683 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.374368:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134755.374373:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.374382:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.374391:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134755.374438:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134755.374516:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+22:2351:x1873946287861632:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 249us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134755.374524:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00010000:00010000:2.0:1787134755.374659:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374680:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134755.374724:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787134755.374729:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134755.374750:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374763:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374773:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374779:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374785:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374791:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134755.374795:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374802:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374811:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:2.0:1787134755.374814:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134755.374827:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374843:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9066c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374854:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374860:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374865:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374871:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134755.374874:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374879:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374887:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98aa44db2f00) 00010000:00010000:2.0:1787134755.374889:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134755.374892:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374898:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9066c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374936:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9066bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907047e expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374949:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907047e expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134755.374964:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:2.0:1787134755.374967:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134755.374969:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450200, rc 0) 00000100:00100000:2.0:1787134755.374997:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+21:10565:x1873946287861248:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 31572us (31979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134755.375004:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 129 00000040:00080000:1.0:1787134756.284501:0:12100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787134756.284510:0:12100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787134756.284552:0:12100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787134756.284558:0:12100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787134756.292514:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787134756.292525:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787134756.292570:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787134756.292577:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787134756.292706:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafe300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946311993088:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787134756.292835:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa48038540 going to sleep for 11 seconds 00010000:00010000:3.0:1787134756.294105:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134756.296517:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafe300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946311993088:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787134756.303851:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134756.303912:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287861760 00000100:00100000:0.0:1787134756.303924:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287861760 00000100:00100000:0.0:1787134756.304004:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00100000:0.0:1787134756.304016:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+21:10576:x1873946287861760:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787134756.304050:0:11472:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1787134756.304228:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134756.304456:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+21:10576:x1873946287861760:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 329us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134756.304478:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00100000:1.0:1787134756.321491:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134756.321531:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287862016 00000100:00100000:1.0:1787134756.321542:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287862016 00000100:00100000:1.0:1787134756.321598:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 131 00000100:00100000:1.0:1787134756.321608:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+21:10576:x1873946287862016:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787134756.321630:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134756.321653:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070485 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.321760:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9066de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.321777:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9066de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.321790:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9066de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134756.321803:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787134756.322080:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070485 expref: 24 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.322100:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9066de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070485 expref: 23 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.322110:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:1.0:1787134756.322120:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134756.322124:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6200, rc 0) 00000100:00100000:1.0:1787134756.322215:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+23:10576:x1873946287862016:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 607us (733us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787134756.322224:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 131 00000100:00100000:1.0:1787134756.354538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134756.354579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134756.354608:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287862144 00000100:00100000:1.0:1787134756.354618:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287862144 00000100:00100000:1.0:1787134756.354681:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787134756.354692:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+23:2352:x1873946287862144:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134756.354707:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134756.354732:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9066de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070485 expref: 23 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.354749:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:1.0:1787134756.354754:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134756.354835:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+22:2352:x1873946287862144:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 144us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134756.354842:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787134756.354868:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287862400 00000100:00100000:1.0:1787134756.354871:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287862400 00000100:00100000:1.0:1787134756.354900:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 132 00000100:00100000:1.0:1787134756.354908:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+22:10576:x1873946287862400:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787134756.354978:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.355005:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.355017:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.356314:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.356326:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.356334:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.356340:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134756.356345:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.356353:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.356366:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:1.0:1787134756.356369:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787134756.356373:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134756.356379:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae9066ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134756.356540:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+23:10576:x1873946287862400:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 1629us (1956us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787134756.356554:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 132 00000040:00080000:3.0:1787134756.356675:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787134756.356681:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787134756.357217:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787134756.357238:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787134756.365899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134756.365990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287862656 00000100:00100000:3.0:1787134756.366000:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287862656 00000100:00100000:3.0:1787134756.366059:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:3.0:1787134756.366069:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+23:10576:x1873946287862656:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787134756.366384:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+24:10576:x1873946287862656:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 315us (493us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787134756.366402:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:2.0:1787134757.248634:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134757.248660:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311993216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134757.248761:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134757.248908:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311993216 00000100:00100000:1.0:1787134757.248917:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311993216 00000100:00100000:1.0:1787134757.248983:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787134757.248994:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311993216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134757.249026:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134757.249073:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311993216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134757.249081:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787134757.249123:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311993216:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787134757.249246:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787134757.312418:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787134758.315699:0:12151:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787134758.315709:0:12151:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787134758.315757:0:12151:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787134758.315763:0:12151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787134758.351541:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134758.589926:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134758.590967:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287862912 00000100:00100000:0.0:1787134758.590981:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287862912 00000100:00100000:0.0:1787134758.591064:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 133 00000100:00100000:0.0:1787134758.591076:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+24:10597:x1873946287862912:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134758.591103:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134758.591123:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae9066f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907048c expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134758.591235:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae9066fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134758.591251:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae9066fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134758.591466:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae9066fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134758.591481:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787134758.591616:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450a00/0x69932dacae9066f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907048c expref: 27 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134758.591635:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae9066fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907048c expref: 26 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134758.591644:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:0.0:1787134758.591654:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787134758.591658:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451c00, rc 0) 00000100:00100000:0.0:1787134758.591741:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+26:10597:x1873946287862912:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 667us (1825us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787134758.591749:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 133 00000100:00100000:0.0:1787134758.596244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134758.596427:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287863040 00000100:00100000:3.0:1787134758.596438:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287863040 00000100:00100000:3.0:1787134758.596500:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 134 00000100:00100000:3.0:1787134758.596511:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+26:10597:x1873946287863040:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:3.0:1787134758.596582:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134758.596727:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134758.596900:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134758.596930:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134758.596938:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134758.596945:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134758.596951:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134758.596956:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134758.596965:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134758.596977:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:3.0:1787134758.596989:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787134758.596995:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134758.597003:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134758.597084:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+26:10597:x1873946287863040:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 574us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134758.597093:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 134 00000100:00080000:1.0:1787134758.598295:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134758.788623:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311993344:0@lo:400:kworker.0 00000100:00100000:0.0:1787134758.788721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134758.788802:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134758.788809:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311993472:0@lo:400:kworker.0 00000100:00100000:0.0:1787134758.788838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134758.788878:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311993344 00000100:00100000:0.0:1787134758.788887:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311993344 00000100:00100000:0.0:1787134758.788935:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787134758.788945:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311993344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134758.788995:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311993344:12345-0@lo:400:kworker.0 Request processed in 52us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134758.789003:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787134758.789058:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311993344:0@lo:400:kworker.0 00000100:00100000:1.0:1787134758.789275:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311993600:0@lo:400:kworker.0 00000100:00100000:1.0:1787134758.789306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134758.789346:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311993472 00000100:00100000:1.0:1787134758.789350:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311993472 00000100:00100000:1.0:1787134758.789375:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311993600 00000100:00100000:1.0:1787134758.789377:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311993600 00000100:00100000:1.0:1787134758.789402:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787134758.789408:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311993472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134758.789457:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946311993472:12345-0@lo:400:kworker.0 Request processed in 49us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134758.789464:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787134758.789478:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787134758.789484:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311993600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134758.789515:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311993600:12345-0@lo:400:kworker.0 Request processed in 31us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134758.789521:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1787134758.789535:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134758.789556:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311993600:0@lo:400:kworker.0 00000100:00100000:1.0:1787134758.789604:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787134758.789610:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7424b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311993728:0@lo:400:kworker.0 00000100:00100000:1.0:1787134758.789635:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134758.789710:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946311993472:0@lo:400:kworker.0 00000100:00100000:3.0:1787134758.800990:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311993728 00000100:00100000:3.0:1787134758.801006:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311993728 00000100:00100000:3.0:1787134758.801065:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787134758.801075:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311993728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134758.801193:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311993728:12345-0@lo:400:kworker.0 Request processed in 118us (11555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134758.801201:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787134758.801230:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311993984:0@lo:400:kworker.0 00000100:00100000:3.0:1787134758.801279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134758.801311:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787134758.801318:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311993856:0@lo:400:kworker.0 00000100:00100000:3.0:1787134758.801342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134758.801368:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311993984 00000100:00100000:3.0:1787134758.801372:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311993984 00000100:00100000:3.0:1787134758.801412:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787134758.801420:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1873946311993984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134758.801456:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1873946311993984:12345-0@lo:400:kworker.0 Request processed in 37us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134758.801481:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787134758.801527:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7424b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311993728:0@lo:400:kworker.0 00000100:00100000:3.0:1787134758.801558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311993856 00000100:00100000:3.0:1787134758.801562:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311993856 00000100:00100000:3.0:1787134758.801592:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787134758.801599:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311993856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134758.801632:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311993856:12345-0@lo:400:kworker.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134758.801638:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1787134758.801653:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787134758.801659:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134758.801676:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311993856:0@lo:400:kworker.0 00000100:00100000:3.0:1787134758.801685:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311993984:0@lo:400:kworker.0 00000100:00100000:3.0:1787134758.864117:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134758.867699:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287863168 00000100:00100000:0.0:1787134758.867715:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287863168 00000100:00100000:0.0:1787134758.867800:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:0.0:1787134758.867812:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2350:x1873946287863168:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:0.0:1787134758.867830:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134758.867862:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae90670f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070493 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787134758.867890:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a858322, atime: 0x6a858321, ctime: 0x6a858322, blocks: 0xb 00010000:00010000:0.0:1787134758.867910:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1787134758.867915:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134758.867925:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae90670f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070493 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134758.867947:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae90670f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070493 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134758.867962:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450a00, rc 0) 00000100:00100000:0.0:1787134758.868029:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:2350:x1873946287863168:12345-192.168.202.36@tcp:101:cat.0 Request processed in 220us (3922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134758.868036:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00080000:2.0:1787134758.868422:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134758.891463:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134758.891552:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287863296 00000100:00100000:3.0:1787134758.891562:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287863296 00002000:00100000:3.0:1787134758.891615:0:6688:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98aa73cc4e00 x1873946287863296/t0(0) o3->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:694/0 lens 488/0 e 0 to 0 dl 1787134769 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787134758.891626:0:6688:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa73cc4e00 with x1873946287863296 ext(0->4095) 00002000:00010000:3.0:1787134758.891632:0:6688:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa73cc4e00 00000100:00100000:3.0:1787134758.891676:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:3.0:1787134758.891687:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287863296:12345-192.168.202.36@tcp:3:cat.0 00000100:00100000:3.0:1787134758.892070:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287863296:12345-192.168.202.36@tcp:3:cat.0 Request processed in 383us (618us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787134758.892086:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00002000:00100000:3.0:1787134758.892094:0:6688:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98aa73cc4e00 x1873946287863296/t0(0) o3->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:694/0 lens 488/4536 e 0 to 0 dl 1787134769 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787134758.892102:0:6688:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa73cc4e00 with x1873946287863296 ext(0->4095) 00002000:00010000:3.0:1787134758.892105:0:6688:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa73cc4e00 00000001:00080000:1.0:1787134758.946625:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000004:00080000:1.0:1787134759.296486:0:7838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375263324333ns, next at 376263321914ns, rc = 0 00000100:00100000:0.0:1787134759.296615:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134759.296639:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311994112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134759.296708:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134759.296872:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311994112 00000100:00100000:1.0:1787134759.296880:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311994112 00000100:00100000:1.0:1787134759.296929:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787134759.296938:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1873946311994112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134759.296967:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134759.297024:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1873946311994112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134759.297032:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787134759.297145:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311994112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134759.360435:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134759.677473:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134759.677510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134759.677557:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134759.677591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134759.677621:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287863680 00000100:00100000:1.0:1787134759.677631:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287863680 00000100:00100000:1.0:1787134759.677694:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 90 00000100:00100000:1.0:1787134759.677705:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287863680:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134759.677797:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287863680:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 94us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134759.677804:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 90 00000100:00100000:1.0:1787134759.677827:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287863552 00000100:00100000:1.0:1787134759.677831:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287863552 00000100:00100000:1.0:1787134759.677855:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287863808 00000100:00100000:1.0:1787134759.677858:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287863808 00000100:00100000:1.0:1787134759.677890:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 160 00000100:00100000:1.0:1787134759.677896:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+26:2351:x1873946287863552:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134759.677926:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+26:2351:x1873946287863552:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134759.677932:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 160 00000100:00100000:1.0:1787134759.677944:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 161 00000100:00100000:1.0:1787134759.677951:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:602cf179-3fa4-4e4c-92db-c355fb291830+5:2351:x1873946287863808:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134759.677976:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:602cf179-3fa4-4e4c-92db-c355fb291830+5:2351:x1873946287863808:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134759.677982:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 161 00000100:00100000:3.0:1787134759.678628:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287863424 00000100:00100000:3.0:1787134759.678634:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287863424 00000100:00100000:3.0:1787134759.678672:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 296 00000100:00100000:3.0:1787134759.678679:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287863424:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134759.678720:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287863424:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 42us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134759.678736:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 296 00000100:00080000:2.0:1787134759.681193:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787134759.681203:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787134760.387206:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787134760.456934:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000004:00080000:1.0:1787134760.456969:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1787134760.457000:0:5858:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98aa47fb7000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787134760.457005:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa47cffc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98aa47fb7b40 00000020:00080000:1.0:1787134760.457008:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa47cff700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98aa81aa0000 00000020:00080000:1.0:1787134760.457018:0:5858:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787134760.457104:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787134760.457336:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1787134760.457358:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311994240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787134760.457433:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134760.457507:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311994240 00000100:00100000:1.0:1787134760.457515:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311994240 00000100:00100000:1.0:1787134760.457587:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787134760.457598:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1873946311994240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787134760.457814:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787134760.457818:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787134754 -> 1787134754 00002000:00010000:1.0:1787134760.457820:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1787134753 -> 1787134753 00002000:00010000:1.0:1787134760.457822:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787134754 -> 1787134754 00002000:00010000:1.0:1787134760.457824:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787134760.457866:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3310:x1873946311994240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 270us (432us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787134760.457874:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1787134760.457921:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa6ff85500/2, rc 0, transno 4294967312 00000100:00100000:1.0:1787134760.457927:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311994240:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1787134760.458373:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787134760.486228:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787134760.486252:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1787134761.421990:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134762.368736:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7ae48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311994368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787134762.368825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134762.368925:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311994368 00000100:00100000:3.0:1787134762.368935:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311994368 00000100:00100000:3.0:1787134762.369004:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787134762.369015:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311994368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134762.369052:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134762.369119:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946311994368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134762.369127:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787134762.369149:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787134762.369224:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787134762.369230:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98aa819e6680, transno 4294967304 00000100:00100000:3.0:1787134762.369246:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7ae48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311994368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787134762.433368:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134763.456535:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787134763.520642:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134763.520656:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134763.521002:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1787134763.521018:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787134763.904945:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311994624:0@lo:400:kworker.0 00000100:00100000:1.0:1787134763.905034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134763.905114:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311995136:0@lo:400:kworker.0 00000100:00100000:1.0:1787134763.905143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134763.905191:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787134763.905197:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311994752:0@lo:400:kworker.0 00000100:00100000:1.0:1787134763.905222:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134763.905255:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311994624 00000100:00100000:1.0:1787134763.905262:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311994624 00000100:00100000:1.0:1787134763.905306:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311994752 00000100:00100000:1.0:1787134763.905309:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311994752 00000100:00100000:1.0:1787134763.905338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787134763.905347:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311994624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134763.905406:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311994624:12345-0@lo:400:kworker.0 Request processed in 59us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134763.905414:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787134763.905433:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787134763.905440:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311994752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134763.905468:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311994752:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134763.905474:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1787134763.905497:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134763.905529:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311994752:0@lo:400:kworker.0 00000100:00100000:1.0:1787134763.905540:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311994624:0@lo:400:kworker.0 00000100:00100000:3.0:1787134763.906032:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311994496:0@lo:400:kworker.0 00000100:00100000:3.0:1787134763.906070:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134763.906103:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311995008:0@lo:400:kworker.0 00000100:00100000:3.0:1787134763.906127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134763.906146:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787134763.906152:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311994880:0@lo:400:kworker.0 00000100:00100000:3.0:1787134763.906201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134763.906227:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311995008 00000100:00100000:3.0:1787134763.906231:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311995008 00000100:00100000:0.0:1787134763.906251:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311995136 00000100:00100000:0.0:1787134763.906255:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311995136 00000100:00100000:3.0:1787134763.906260:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787134763.906266:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311995008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134763.906281:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311994880 00000100:00100000:0.0:1787134763.906284:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311994880 00000100:00100000:3.0:1787134763.906302:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311995008:12345-0@lo:400:kworker.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134763.906303:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787134763.906308:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787134763.906310:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311995136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134763.906336:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311995008:0@lo:400:kworker.0 00000100:00100000:0.0:1787134763.906369:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311995136:12345-0@lo:400:kworker.0 Request processed in 60us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134763.906374:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787134763.906378:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787134763.906380:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311994880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134763.906402:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1787134763.906408:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98aa6fd96d80, transno 4294967309 00000100:00100000:3.0:1787134763.906416:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311994880:12345-0@lo:400:kworker.0 Request processed in 37us (215us total) trans 0 rc 0/0 00000004:00080000:0.0:1787134763.906419:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:3.0:1787134763.906422:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787134763.906437:0:3309:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff98aa6ff85500 x1873946311994240/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787134776 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134763.906445:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311994880:0@lo:400:kworker.0 00000100:00100000:0.0:1787134763.906459:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311995136:0@lo:400:kworker.0 00000100:00100000:1.0:1787134763.907301:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311994496 00000100:00100000:1.0:1787134763.907310:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311994496 00000100:00100000:1.0:1787134763.907351:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787134763.907359:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311994496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134763.907416:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311994496:12345-0@lo:400:kworker.0 Request processed in 59us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134763.907423:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:1.0:1787134763.907456:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787134763.907460:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134763.907482:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311994496:0@lo:400:kworker.0 00000100:00100000:2.0:1787134764.416878:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134764.416905:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311995264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134764.416988:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134764.417143:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311995264 00000100:00100000:3.0:1787134764.417177:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311995264 00000100:00100000:3.0:1787134764.417238:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787134764.417248:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311995264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134764.417297:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134764.418042:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311995264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 791us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134764.418053:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787134764.418193:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311995264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787134764.480432:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134764.792301:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134764.792347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134764.792384:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134764.792413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134764.792452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134764.792484:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287864448 00000100:00100000:1.0:1787134764.792497:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287864448 00000100:00100000:1.0:1787134764.792565:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287864064 00000100:00100000:1.0:1787134764.792569:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287864064 00000100:00100000:1.0:1787134764.792596:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 165 00000100:00100000:1.0:1787134764.792607:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287864448:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134764.792707:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287864448:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 101us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134764.792715:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 165 00000100:00100000:1.0:1787134764.792743:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 166 00000100:00100000:1.0:1787134764.792750:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+13:2349:x1873946287864064:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134764.792797:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+13:2349:x1873946287864064:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 47us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134764.792803:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 166 00000100:00080000:1.0:1787134764.792838:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134764.795473:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287863936 00000100:00100000:0.0:1787134764.795487:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287863936 00000100:00100000:0.0:1787134764.795548:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 298 00000100:00100000:0.0:1787134764.795555:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287863936:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134764.795625:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287863936:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 72us (3341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134764.795630:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 298 00000100:00100000:0.0:1787134764.795659:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287864192 00000100:00100000:0.0:1787134764.795663:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287864192 00000100:00100000:0.0:1787134764.795697:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287864320 00000100:00100000:0.0:1787134764.795701:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287864320 00000100:00100000:0.0:1787134764.795724:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:0.0:1787134764.795750:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287864192:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134764.795781:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287864192:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (3433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134764.795787:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:0.0:1787134764.795798:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:0.0:1787134764.795802:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287864320:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134764.795820:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287864320:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 19us (3370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134764.795824:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00080000:0.0:1787134764.795931:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134764.795935:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787134765.506543:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787134765.527088:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000020:00080000:1.0:1787134765.544043:0:5858:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787134765.544100:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787134765.544111:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787134765.662218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134765.662389:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287864576 00000100:00100000:2.0:1787134765.662399:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287864576 00000100:00100000:2.0:1787134765.662683:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 135 00000100:00100000:2.0:1787134765.662697:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+13:10242:x1873946287864576:12345-192.168.202.36@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787134765.662851:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+13:10242:x1873946287864576:12345-192.168.202.36@tcp:60:lhsmtool_posix.0 Request processed in 157us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134765.662884:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 135 00000100:00100000:0.0:1787134765.673038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134765.673206:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287864832 00000100:00100000:3.0:1787134765.673221:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287864832 00000100:00100000:3.0:1787134765.673304:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:3.0:1787134765.673332:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+13:10242:x1873946287864832:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787134765.674198:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+14:10242:x1873946287864832:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 871us (1170us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787134765.674209:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:1.0:1787134766.123627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134766.123846:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287864960 00000100:00100000:3.0:1787134766.123862:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287864960 00000100:00100000:3.0:1787134766.123954:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 136 00000100:00100000:3.0:1787134766.123966:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+5:11051:x1873946287864960:12345-192.168.202.36@tcp:101:lsof.0 00010000:00010000:3.0:1787134766.123989:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134766.124025:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906716 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907049a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134766.124100:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134766.124137:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134766.124152:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134766.124713:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787134766.124742:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787134766.124851:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134766.124881:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906716 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907049a expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134766.124900:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907049a expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134766.124910:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:3.0:1787134766.124913:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787134766.124917:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b400, rc 0) 00000100:00100000:3.0:1787134766.124990:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+6:11051:x1873946287864960:12345-192.168.202.36@tcp:101:lsof.0 Request processed in 1026us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134766.125006:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 136 00000100:00080000:0.0:1787134766.125733:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787134766.528643:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134767.488801:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134767.488833:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311995392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787134767.488908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134767.489191:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311995392 00000100:00100000:2.0:1787134767.489200:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311995392 00000100:00100000:2.0:1787134767.489279:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787134767.489291:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311995392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787134767.489341:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134767.489412:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311995392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134767.489420:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787134767.489780:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787134767.489828:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311995392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787134767.553620:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134768.576374:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134769.025715:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311995520:0@lo:400:kworker.0 00000100:00100000:2.0:1787134769.025798:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134769.025856:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311996032:0@lo:400:kworker.0 00000100:00100000:2.0:1787134769.025883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134769.025910:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787134769.025916:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311995904:0@lo:400:kworker.0 00000100:00100000:2.0:1787134769.025940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134769.025986:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311995520 00000100:00100000:2.0:1787134769.025994:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311995520 00000100:00100000:2.0:1787134769.026044:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787134769.026054:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311995520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134769.026105:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3308:x1873946311995520:12345-0@lo:400:kworker.0 Request processed in 52us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134769.026112:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787134769.026146:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311996032 00000100:00100000:2.0:1787134769.026150:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311996032 00000100:00100000:2.0:1787134769.026236:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787134769.026243:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311996032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134769.026289:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311996032:12345-0@lo:400:kworker.0 Request processed in 47us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134769.026295:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787134769.026313:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311995904 00000100:00100000:2.0:1787134769.026317:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311995904 00000100:00100000:2.0:1787134769.026345:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787134769.026352:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311995904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134769.026381:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311995904:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134769.026388:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787134769.026413:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787134769.026418:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134769.026672:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311995904:0@lo:400:kworker.0 00000100:00100000:2.0:1787134769.026682:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946311995520:0@lo:400:kworker.0 00000100:00100000:2.0:1787134769.026700:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311996032:0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.027326:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311995776:0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.027370:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134769.027401:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787134769.027408:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311995648:0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.027428:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134769.027447:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311996160:0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.027468:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134769.027493:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311996160 00000100:00100000:0.0:1787134769.027498:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311996160 00000100:00100000:0.0:1787134769.027533:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787134769.027551:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311996160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.027590:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311996160:12345-0@lo:400:kworker.0 Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134769.027596:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787134769.027612:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134769.027623:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311995776 00000100:00100000:0.0:1787134769.027626:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311995776 00000100:00100000:0.0:1787134769.027661:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311995648 00000100:00100000:0.0:1787134769.027664:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311995648 00000100:00100000:0.0:1787134769.027706:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787134769.027714:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311995776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.027745:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946311995776:12345-0@lo:400:kworker.0 Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134769.027751:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787134769.027762:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787134769.027768:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311995648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.027792:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946311995648:12345-0@lo:400:kworker.0 Request processed in 25us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134769.027799:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1787134769.027815:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134769.027835:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946311995648:0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.027843:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1787134769.027847:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98aa6ff85500, transno 4294967312 00000100:00100000:0.0:1787134769.027856:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311996160:0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.027864:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946311995776:0@lo:400:kworker.0 00000100:00100000:0.0:1787134769.536577:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311996288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134769.536679:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134769.536773:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311996288 00000100:00100000:0.0:1787134769.536782:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311996288 00000100:00100000:2.0:1787134769.551725:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787134769.551748:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311996288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787134769.551790:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134769.551888:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946311996288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (15219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134769.551896:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787134769.552006:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946311996288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134769.602309:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134769.924097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134769.924149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134769.924209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134769.924228:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134769.924253:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134769.924290:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287865600 00000100:00100000:1.0:1787134769.924300:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287865600 00000100:00100000:2.0:1787134769.924317:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287865088 00000100:00100000:2.0:1787134769.924321:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287865088 00000100:00100000:1.0:1787134769.924358:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287865216 00000100:00100000:1.0:1787134769.924360:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287865216 00000100:00100000:2.0:1787134769.924362:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 300 00000100:00100000:2.0:1787134769.924371:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287865088:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134769.924378:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 170 00000100:00100000:1.0:1787134769.924383:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+6:2351:x1873946287865600:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134769.924447:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2351:x1873946287865088:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 76us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134769.924455:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 300 00000100:00100000:2.0:1787134769.924488:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 171 00000100:00100000:2.0:1787134769.924496:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+14:2351:x1873946287865216:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134769.924584:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+6:2351:x1873946287865600:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 199us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134769.924592:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 170 00000100:00080000:1.0:1787134769.924612:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134769.926100:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287865344 00000100:00100000:3.0:1787134769.926113:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287865344 00000100:00100000:3.0:1787134769.926184:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287865472 00000100:00100000:3.0:1787134769.926187:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287865472 00000100:00100000:3.0:1787134769.926228:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 97 00000100:00100000:3.0:1787134769.926237:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287865344:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134769.926613:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2351:x1873946287865344:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 376us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134769.926621:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 97 00000100:00100000:3.0:1787134769.926641:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:3.0:1787134769.926647:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287865472:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134769.926674:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287865472:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 27us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134769.926680:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:2.0:1787134769.927304:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+14:2351:x1873946287865216:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 2805us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134769.927315:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 171 00000100:00080000:2.0:1787134769.929549:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787134769.929557:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787134770.570734:0:12355:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:19:28 (1787134768) 00010000:00010000:3.0:1787134770.626583:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787134770.707782:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:0.0:1787134771.650768:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134772.256297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134772.256449:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287865856 00000100:00100000:3.0:1787134772.256460:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287865856 00000100:00080000:2.0:1787134772.256595:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134772.256753:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 137 00000100:00100000:3.0:1787134772.256764:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+13:11316:x1873946287865856:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134772.256784:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134772.256805:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906724 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.256881:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.256896:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.256919:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.256944:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.256951:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.256957:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.257408:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906739 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.257420:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906739 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.257427:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906739 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134772.257437:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787134772.258018:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258028:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258034:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258039:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134772.258044:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258060:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258072:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98aa44db2c00) 00010000:00010000:3.0:1787134772.258075:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134772.258079:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258084:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90672b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258095:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258100:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258105:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258109:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134772.258111:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258116:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258121:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98aa42a7c100) 00010000:00010000:3.0:1787134772.258123:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134772.258125:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.258138:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906732 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.266872:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae906724 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704a1 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.267738:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906739 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704a1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.267750:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:3.0:1787134772.267753:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134772.267757:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7ae00, rc 0) 00000100:00100000:3.0:1787134772.267887:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+15:11316:x1873946287865856:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 11124us (11596us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787134772.267896:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 137 00000100:00100000:1.0:1787134772.286216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134772.286264:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134772.286412:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287866112 00000100:00100000:3.0:1787134772.286423:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287866112 00000100:00100000:3.0:1787134772.286495:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:3.0:1787134772.286505:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+15:2350:x1873946287866112:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134772.286522:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134772.286557:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906739 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704a1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134772.286576:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:3.0:1787134772.286583:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134772.286655:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+14:2350:x1873946287866112:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 151us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134772.286686:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787134772.287468:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287865984 00000100:00100000:0.0:1787134772.287477:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287865984 00000100:00100000:0.0:1787134772.287521:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 138 00000100:00100000:0.0:1787134772.287530:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+14:11316:x1873946287865984:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787134772.287636:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+14:11316:x1873946287865984:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 Request processed in 107us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134772.287643:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 138 00000100:00100000:2.0:1787134772.608469:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787134772.608494:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311996416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134772.608583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134772.608880:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311996416 00000100:00100000:3.0:1787134772.608890:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311996416 00000100:00100000:3.0:1787134772.608960:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787134772.608970:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311996416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134772.609008:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134772.609062:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311996416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134772.609070:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787134772.609120:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311996416:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787134772.609489:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787134772.672571:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787134772.736405:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134772.736416:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134772.736928:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787134772.736938:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787134773.698904:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787134773.761286:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134773.761297:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134773.761691:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787134773.761698:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787134774.148408:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134774.148443:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311996544:0@lo:400:kworker.0 00000100:00100000:0.0:1787134774.148525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134774.149210:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311996544 00000100:00100000:1.0:1787134774.149219:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311996544 00000100:00100000:1.0:1787134774.149273:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787134774.149283:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311996544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134774.149346:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946311996544:12345-0@lo:400:kworker.0 Request processed in 65us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134774.149353:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787134774.149415:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946311996544:0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.154622:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311996672:0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.154717:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134774.154754:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311997184:0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.154779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134774.154806:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134774.154812:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311996800:0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.154833:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134774.154866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311996672 00000100:00100000:2.0:1787134774.154888:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311996672 00000100:00100000:2.0:1787134774.154935:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311996800 00000100:00100000:2.0:1787134774.154938:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311996800 00000100:00100000:2.0:1787134774.154967:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787134774.154975:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311996672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.155027:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946311996672:12345-0@lo:400:kworker.0 Request processed in 52us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134774.155033:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787134774.155051:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787134774.155058:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311996800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.155084:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873946311996800:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134774.155090:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787134774.155108:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311997184 00000100:00100000:2.0:1787134774.155111:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311997184 00000100:00100000:2.0:1787134774.155138:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787134774.155144:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311997184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.155212:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311997184:12345-0@lo:400:kworker.0 Request processed in 68us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134774.155218:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1787134774.155236:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787134774.155241:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134774.155273:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1873946311996800:0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.155290:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946311996672:0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.155300:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311997184:0@lo:400:kworker.0 00000100:00100000:1.0:1787134774.166852:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311997056:0@lo:400:kworker.0 00000100:00100000:1.0:1787134774.166948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134774.166990:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134774.166998:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311996928:0@lo:400:kworker.0 00000100:00100000:1.0:1787134774.167023:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134774.167055:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311997056 00000100:00100000:1.0:1787134774.167063:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311997056 00000100:00100000:1.0:1787134774.167114:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787134774.167123:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311997056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134774.167200:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946311997056:12345-0@lo:400:kworker.0 Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134774.167208:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787134774.167233:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311996928 00000100:00100000:1.0:1787134774.167236:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311996928 00000100:00100000:1.0:1787134774.167263:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787134774.167270:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311996928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134774.167309:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946311996928:12345-0@lo:400:kworker.0 Request processed in 40us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134774.167316:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1787134774.167332:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787134774.167337:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134774.167390:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946311996928:0@lo:400:kworker.0 00000100:00100000:1.0:1787134774.167403:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946311997056:0@lo:400:kworker.0 00000100:00100000:2.0:1787134774.653622:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134774.653776:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287866240 00000100:00100000:3.0:1787134774.653790:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287866240 00000100:00100000:3.0:1787134774.653868:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 139 00000100:00100000:3.0:1787134774.653878:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+14:11359:x1873946287866240:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787134774.653899:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134774.653920:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704a8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.653989:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654006:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654020:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654049:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654056:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654064:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654344:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654352:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654358:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654363:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134774.654367:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654374:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654387:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:3.0:1787134774.654390:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134774.654395:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654401:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90674e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654417:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654423:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654429:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654434:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134774.654437:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654442:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654448:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98aa42a7cc00) 00010000:00010000:3.0:1787134774.654450:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134774.654452:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654457:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906755 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654489:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906747 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704a8 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654499:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:3.0:1787134774.654502:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134774.654510:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704a8 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.654519:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7ae00, rc 0) 00000100:00100000:3.0:1787134774.654580:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+14:11359:x1873946287866240:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 703us (967us total) trans 0 rc 301/301 00000100:00100000:3.0:1787134774.654587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 139 00000100:00080000:2.0:1787134774.654830:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134774.658511:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134774.658545:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311997312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134774.659300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134774.659689:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311997312 00000100:00100000:3.0:1787134774.659699:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311997312 00000100:00100000:3.0:1787134774.659755:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787134774.659765:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311997312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134774.659802:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134774.659856:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311997312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134774.659865:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787134774.659950:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311997312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134774.673433:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134774.676331:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287866496 00000100:00100000:1.0:1787134774.676348:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287866496 00000100:00100000:0.0:1787134774.680027:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 140 00000100:00100000:0.0:1787134774.680040:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+14:11359:x1873946287866496:12345-192.168.202.36@tcp:36:lfs.0 00010000:00010000:0.0:1787134774.680104:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134774.680136:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae9060c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702e1 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.680153:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:0.0:1787134774.680174:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787134774.680447:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.680463:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907049a expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.680472:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.680508:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907049a expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.680707:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907049a expref: 5 pid: 5835 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134774.680723:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fc19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311997440:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134774.681671:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457af6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134774.687111:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134774.687143:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287866624 00000100:00100000:1.0:1787134774.687152:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287866624 00010000:00010000:1.0:1787134774.687232:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907049a expref: 6 pid: 5835 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134774.687326:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:1.0:1787134774.687338:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81037800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:602cf179-3fa4-4e4c-92db-c355fb291830+6:2351:x1873946287866624:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134774.687356:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134774.687363:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907049a expref: 6 pid: 5835 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.687378:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907049a expref: 6 pid: 5835 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.687400:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:1.0:1787134774.687406:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.687427:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.687435:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.687455:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134774.687510:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81037800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:602cf179-3fa4-4e4c-92db-c355fb291830+6:2351:x1873946287866624:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 174us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134774.687517:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00010000:00010000:3.0:1787134774.687775:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae90671d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907049a expref: 5 pid: 5835 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134774.687791:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fc19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311997440:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134774.687811:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.687819:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.687825:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.687847:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.687862:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.687870:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787134774.689604:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787134774.697985:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787134774.698007:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.698018:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.698025:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.698031:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134774.698036:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.698044:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.698060:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa50ade300) 00010000:00010000:0.0:1787134774.698064:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134774.698068:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.698074:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90675c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787134774.698093:0:5836:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000423a5e7a reply state 000000000578961d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134774.698102:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787134774.699735:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+15:11359:x1873946287866496:12345-192.168.202.36@tcp:36:lfs.0 Request processed in 19687us (26301us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787134774.699748:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 140 00010000:00010000:3.0:1787134774.702305:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.702324:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.702332:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.702337:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ae00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134774.702342:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.702349:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.702366:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98aa42a7cc00) 00010000:00010000:3.0:1787134774.702369:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134774.702374:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.702380:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae906763 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.720347:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134774.857712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134774.857992:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287866752 00000100:00100000:3.0:1787134774.858004:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287866752 00000100:00100000:3.0:1787134774.858066:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 141 00000100:00100000:3.0:1787134774.858076:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+14:11367:x1873946287866752:12345-192.168.202.36@tcp:101:lctl.0 00010000:00010000:3.0:1787134774.858103:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134774.858127:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90676a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704af expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.858231:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906771 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.858247:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.858269:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134774.858470:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787134774.858475:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787134774.858509:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.858534:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90676a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704af expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.858552:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704af expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.858561:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cc00) 00010000:00010000:3.0:1787134774.858564:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787134774.858575:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b400, rc 0) 00000100:00100000:3.0:1787134774.858876:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+15:11367:x1873946287866752:12345-192.168.202.36@tcp:101:lctl.0 Request processed in 800us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134774.858884:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 141 00000100:00100000:0.0:1787134774.917582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134774.917806:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287866880 00000100:00100000:2.0:1787134774.917817:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287866880 00000100:00100000:2.0:1787134774.917882:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 142 00000100:00100000:2.0:1787134774.917892:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+15:11373:x1873946287866880:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134774.917917:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134774.917939:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906778 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704b6 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918007:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918022:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918033:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918050:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918056:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918062:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918230:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae90678d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918256:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae90678d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918278:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae90678d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134774.918313:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787134774.918317:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134774.918355:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae90678d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918368:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918375:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918382:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918389:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134774.918394:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918404:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918418:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cc00) 00010000:00010000:2.0:1787134774.918422:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134774.918427:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918443:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae90677f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918458:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918465:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918471:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918476:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134774.918479:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918485:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918491:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98aa59e99e00) 00010000:00010000:2.0:1787134774.918494:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134774.918496:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918501:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906786 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918530:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906778 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704b6 expref: 17 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918556:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae90678d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704b6 expref: 16 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.918564:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134774.918566:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787134774.918568:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97600, rc 0) 00000100:00100000:2.0:1787134774.918982:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+16:11373:x1873946287866880:12345-192.168.202.36@tcp:101:bash.0 Request processed in 1089us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134774.918991:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 142 00000100:00100000:1.0:1787134774.926531:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134774.926622:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287867136 00000100:00100000:0.0:1787134774.926634:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287867136 00000100:00100000:0.0:1787134774.926723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 143 00000100:00100000:0.0:1787134774.926734:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+16:11373:x1873946287867136:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787134774.926758:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134774.926779:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906794 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704bd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.926923:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.926938:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.926949:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.926964:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.926971:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.926977:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787134774.927534:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787134774.927697:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927707:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927722:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927760:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927766:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927773:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927778:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134774.927783:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927790:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927804:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134774.927809:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134774.927815:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927822:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90679b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787134774.927837:0:5836:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000b421a878 reply state 00000000d1a89ae0 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134774.927845:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787134774.927887:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906794 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704bd expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927902:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704bd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134774.927911:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2700) 00010000:00010000:0.0:1787134774.927913:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134774.927916:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450000, rc 0) 00000100:00100000:0.0:1787134774.928005:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+19:11373:x1873946287867136:12345-192.168.202.36@tcp:101:bash.0 Request processed in 1272us (1491us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787134774.928013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 143 00010000:00010000:1.0:1787134774.941478:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.941497:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.941505:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.941511:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134774.941516:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.941531:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.941548:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa44db2000) 00010000:00010000:1.0:1787134774.941550:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134774.941555:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134774.941575:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae9067a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134774.943298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134774.943714:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287867264 00000100:00100000:2.0:1787134774.943727:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287867264 00000100:00100000:2.0:1787134774.943792:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:2.0:1787134774.943802:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287867264:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134774.943821:0:7839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134774.943841:0:7839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704c4 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787134774.943868:0:7839:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134774.943894:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1787134774.943899:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134774.943909:0:7839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704c4 expref: 6 pid: 7839 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.943928:0:7839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704c4 expref: 6 pid: 7839 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.943961:0:7839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96000, rc 0) 00000100:00100000:2.0:1787134774.944021:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287867264:12345-192.168.202.36@tcp:101:bash.0 Request processed in 220us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134774.944036:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00080000:0.0:1787134774.944356:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134774.949669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134774.949947:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287867392 00000100:00100000:2.0:1787134774.949960:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287867392 00000100:00100000:2.0:1787134774.950033:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:2.0:1787134774.950045:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+6:11373:x1873946287867392:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134774.950067:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134774.950088:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704cb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.950127:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704c4 expref: 7 pid: 7839 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.950138:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134774.950143:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134774.950149:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.950234:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704c4 expref: 7 pid: 7839 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.950249:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704c4 expref: 7 pid: 7839 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134774.950293:0:6680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1873946311997568:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134774.950761:0:6680:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f7493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134774.954566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134774.954869:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287867520 00000100:00100000:3.0:1787134774.954880:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287867520 00010000:00010000:3.0:1787134774.954925:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704c4 expref: 8 pid: 7839 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134774.954965:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:3.0:1787134774.954974:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287867520:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134774.954990:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134774.955011:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704c4 expref: 8 pid: 7839 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.955084:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704c4 expref: 8 pid: 7839 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.955112:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134774.955116:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134774.955126:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.955136:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134774.955252:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134774.955283:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1873946311997696:192.168.202.36@tcp:105: 00000100:00100000:3.0:1787134774.955409:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8ff00 going to sleep for 11 seconds 00010000:00010000:2.0:1787134774.955571:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000221a35e2/0x69932dacae9067b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704c4 expref: 8 pid: 7839 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134774.955598:0:6680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1873946311997568:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134774.955623:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134774.955634:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96600, rc 0) 00000100:00100000:2.0:1787134774.955675:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+7:11373:x1873946287867392:12345-192.168.202.36@tcp:101:bash.0 Request processed in 5632us (6016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134774.955682:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:1.0:1787134774.961957:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134774.962533:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1873946311997696:192.168.202.36@tcp:105: 00010000:00010000:3.0:1787134774.962557:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134774.962910:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287867520:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 7933us (8349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134774.962923:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:2.0:1787134774.964225:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287867776 00000100:00100000:2.0:1787134774.964240:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287867776 00000100:00100000:2.0:1787134774.964303:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:2.0:1787134774.964313:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+18:11373:x1873946287867776:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:2.0:1787134774.965148:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+19:11373:x1873946287867776:12345-192.168.202.36@tcp:35:bash.0 Request processed in 831us (3197us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787134774.965197:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:1.0:1787134775.032235:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134775.032285:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134775.032327:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.032496:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287868032 00000100:00100000:2.0:1787134775.032506:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287868032 00000100:00100000:2.0:1787134775.032596:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:2.0:1787134775.032622:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287868032:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134775.032734:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2349:x1873946287868032:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 115us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134775.032742:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:0.0:1787134775.032790:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287868160 00000100:00100000:0.0:1787134775.032795:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287868160 00000100:00100000:0.0:1787134775.032839:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 175 00000100:00100000:0.0:1787134775.032847:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287868160:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134775.032878:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287868160:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134775.032884:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 175 00000100:00080000:1.0:1787134775.032894:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134775.033268:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287867904 00000100:00100000:3.0:1787134775.033274:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287867904 00000100:00100000:3.0:1787134775.033314:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 302 00000100:00100000:3.0:1787134775.033322:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287867904:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134775.033367:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287867904:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 46us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134775.033374:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 302 00000100:00100000:1.0:1787134775.069850:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.069966:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287868416 00000100:00100000:2.0:1787134775.069977:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287868416 00000100:00100000:2.0:1787134775.070105:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 144 00000100:00100000:2.0:1787134775.070117:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+19:11383:x1873946287868416:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134775.070146:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134775.070199:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9067c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704d2 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134775.070344:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787134775.070472:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9067c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704d2 expref: 21 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.070500:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cc00) 00010000:00010000:2.0:1787134775.070504:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134775.070509:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9067c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704d2 expref: 21 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.070527:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96000, rc 0) 00000100:00100000:2.0:1787134775.070607:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+20:11383:x1873946287868416:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 493us (768us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787134775.070615:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 144 00000100:00100000:0.0:1787134775.076450:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.076721:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287868672 00000100:00100000:2.0:1787134775.076748:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287868672 00000100:00100000:2.0:1787134775.076856:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:2.0:1787134775.076866:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+20:11383:x1873946287868672:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787134775.077183:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+21:11383:x1873946287868672:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 295us (721us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787134775.077192:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:1.0:1787134775.184451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.184553:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287868800 00000100:00100000:2.0:1787134775.184563:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287868800 00000100:00100000:2.0:1787134775.184630:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 145 00000100:00100000:2.0:1787134775.184649:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+21:11389:x1873946287868800:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134775.184679:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134775.184706:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9067d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704d9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.184771:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9067da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.184786:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9067da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.184798:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9067da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134775.184860:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787134775.184864:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134775.184885:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9067da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.184911:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9067d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704d9 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.184949:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9067da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704d9 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.184957:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134775.184960:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787134775.184964:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96800, rc 0) 00000100:00100000:2.0:1787134775.185028:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+22:11389:x1873946287868800:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 382us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134775.185034:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 145 00000100:00100000:3.0:1787134775.193609:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.195680:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287869056 00000100:00100000:2.0:1787134775.195698:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287869056 00000100:00100000:2.0:1787134775.195772:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 146 00000100:00100000:2.0:1787134775.195783:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+22:11389:x1873946287869056:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134775.195804:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134775.195828:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9067e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704e0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.195952:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9067e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.195969:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9067e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.195985:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9067e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134775.196000:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787134775.196211:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9067e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704e0 expref: 25 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.196441:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9067e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704e0 expref: 24 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.196451:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2700) 00010000:00010000:2.0:1787134775.196455:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134775.196459:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97400, rc 0) 00000100:00100000:2.0:1787134775.196572:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+24:11389:x1873946287869056:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 790us (2974us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787134775.196581:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 146 00000100:00100000:1.0:1787134775.201977:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134775.202047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.202135:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287869312 00000100:00100000:2.0:1787134775.202146:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287869312 00000100:00100000:2.0:1787134775.202228:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 147 00000100:00100000:2.0:1787134775.202239:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+24:11389:x1873946287869312:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134775.202271:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134775.202309:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9067f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704e7 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.202429:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9067fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.202445:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9067fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.202456:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9067fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134775.202492:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787134775.202642:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9067f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704e7 expref: 27 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.202666:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9067fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704e7 expref: 26 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.202676:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2700) 00010000:00010000:2.0:1787134775.202678:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787134775.202683:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97200, rc 0) 00000100:00100000:2.0:1787134775.202750:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+26:11389:x1873946287869312:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 512us (782us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787134775.202758:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 147 00000100:00100000:3.0:1787134775.203736:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287869440 00000100:00100000:3.0:1787134775.203746:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287869440 00000100:00100000:3.0:1787134775.203800:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:3.0:1787134775.203809:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+26:2350:x1873946287869440:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134775.203822:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134775.203844:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9067e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704e0 expref: 26 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.203860:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2700) 00010000:00010000:3.0:1787134775.203873:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134775.203925:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+25:2350:x1873946287869440:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 117us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134775.203932:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787134775.209561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134775.209755:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287869568 00000100:00100000:3.0:1787134775.209766:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287869568 00000100:00100000:3.0:1787134775.209827:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:3.0:1787134775.209837:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287869568:12345-192.168.202.36@tcp:1:lfs.0 00010000:00010000:3.0:1787134775.209885:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.209907:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.209916:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787134775.209920:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787134775.209925:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.209963:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.209978:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 6 pid: 6680 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134775.209993:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1873946311997824:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134775.210099:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787134775.213123:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1873946311997824:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134775.213196:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134775.214258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134775.214418:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287869696 00000100:00100000:0.0:1787134775.214428:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287869696 00002000:00100000:0.0:1787134775.214485:0:6688:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98aa81e4c000 x1873946287869696/t0(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:711/0 lens 504/0 e 0 to 0 dl 1787134786 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787134775.214495:0:6688:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa81e4c000 with x1873946287869696 ext(0->12) 00010000:00010000:0.0:1787134775.214531:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 7 pid: 6680 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.214547:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 7 pid: 6680 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787134775.214555:0:6688:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98aa81e4c000 00000100:00100000:0.0:1787134775.214592:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:0.0:1787134775.214602:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287869696:12345-192.168.202.36@tcp:4:lfs.0 00000100:00100000:0.0:1787134775.215138:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486fb1ad-4266-4864-b299-111c5140734b+9:2351:x1873946287869696:12345-192.168.202.36@tcp:4:lfs.0 Request processed in 534us (882us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787134775.215148:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00002000:00100000:0.0:1787134775.215181:0:6688:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98aa81e4c000 x1873946287869696/t4294967305(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:711/0 lens 504/448 e 0 to 0 dl 1787134786 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787134775.215188:0:6688:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa81e4c000 with x1873946287869696 ext(0->12) 00010000:00010000:0.0:1787134775.215193:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 9 pid: 6680 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.215202:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 9 pid: 6680 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787134775.215207:0:6688:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98aa81e4c000 00000100:00100000:2.0:1787134775.219059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134775.219780:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287869824 00000100:00100000:1.0:1787134775.219792:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287869824 00010000:00010000:1.0:1787134775.219832:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 9 pid: 6680 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134775.219865:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:1.0:1787134775.219872:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287869824:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134775.219885:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787134775.219904:0:7620:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787134775.219906:0:7620:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787134775 00002000:00010000:1.0:1787134775.219908:0:7620:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787134775 00002000:00010000:1.0:1787134775.219925:0:7620:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787134775 00010000:00010000:1.0:1787134775.219930:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 9 pid: 6680 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134775.219943:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 9 pid: 6680 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134775.219970:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae9067be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704cb expref: 9 pid: 6680 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134775.219990:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134775.219994:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134775.219999:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134775.220005:0:7620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134775.220035:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134775.220086:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+8:2352:x1873946287869824:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 214us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134775.220091:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 61 00010000:00010000:2.0:1787134775.220195:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.220203:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.220225:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.220231:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.220245:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.220250:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ae00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134775.220253:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.220279:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.220293:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.220300:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7e928f4/0x69932dacae90680b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134775.220354:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2352:x1873946287869568:12345-192.168.202.36@tcp:1:lfs.0 Request processed in 10519us (10804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134775.220362:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:2.0:1787134775.234116:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134775.235219:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287870080 00000100:00100000:3.0:1787134775.235236:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287870080 00000100:00100000:3.0:1787134775.235312:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:3.0:1787134775.235325:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa50e40450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+25:11389:x1873946287870080:12345-192.168.202.36@tcp:35:lfs.0 00000004:00010000:3.0:1787134775.235409:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9067fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704e7 expref: 25 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787134775.235811:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787134775.235857:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787134775.236500:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787134775.236567:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.236587:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704bd expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.236597:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.236651:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704bd expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.236668:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704bd expref: 29 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134775.236698:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd95f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1873946311997952:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134775.236802:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787134775.241676:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd95f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1873946311997952:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134775.241712:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134775.244329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134775.244573:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287870208 00000100:00100000:3.0:1787134775.244593:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287870208 00010000:00010000:3.0:1787134775.244654:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704bd expref: 30 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134775.244689:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:3.0:1787134775.244700:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+30:2352:x1873946287870208:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134775.244717:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134775.244724:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704bd expref: 30 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.244738:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704bd expref: 30 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.244761:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9067a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704bd expref: 30 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.244779:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2700) 00010000:00010000:3.0:1787134775.244786:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.244813:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.244821:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.244859:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134775.244930:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+29:2352:x1873946287870208:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 231us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134775.244937:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00010000:00010000:2.0:1787134775.245046:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.245055:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787134775.245233:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787134775.245455:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787134775.245570:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1873946311998080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787134775.245662:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134775.245691:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134775.246255:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311998080 00000100:00100000:3.0:1787134775.246262:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311998080 00000100:00100000:3.0:1787134775.246313:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787134775.246322:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1873946311998080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787134775.246415:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1873946311998080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134775.246422:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787134775.246580:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1873946311998080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787134775.247256:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787134775.247326:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1873946311998208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787134775.247369:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134775.247408:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f7493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134775.248020:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311998208 00000100:00100000:3.0:1787134775.248029:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311998208 00000100:00100000:3.0:1787134775.248074:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787134775.248081:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1873946311998208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787134775.248327:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1873946311998208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 246us (957us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787134775.248336:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787134775.248756:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1873946311998208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787134775.248820:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787134775.248865:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.248886:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.248893:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.248899:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134775.248928:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.248937:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.248952:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2700) 00010000:00010000:0.0:1787134775.248955:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787134775.248960:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.248966:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906812 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787134775.249218:0:5838:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787134775.249341:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1787134775.249353:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391216193920ns, next at 392216191748ns, rc = 0 00000001:00080000:0.0:1787134775.249360:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787134775.249408:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2700) 00010000:00010000:0.0:1787134775.249411:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787134775.249420:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9067fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704e7 expref: 33 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134775.250924:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa50e40450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+32:11389:x1873946287870080:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 15594us (16813us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787134775.250937:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00000020:00080000:0.0:1787134775.250943:0:5838:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787134775.254579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134775.254726:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287870336 00000100:00100000:0.0:1787134775.254739:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287870336 00000100:00100000:0.0:1787134775.254803:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 148 00000100:00100000:0.0:1787134775.254816:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+32:11389:x1873946287870336:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134775.254841:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134775.254865:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906819 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.254931:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906819 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704ee expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.254947:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906819 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704ee expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.254966:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134775.254969:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787134775.254973:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450e00, rc 0) 00000100:00100000:0.0:1787134775.255041:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+33:11389:x1873946287870336:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 227us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134775.255048:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 148 00000100:00100000:1.0:1787134775.258561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.259088:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287870592 00000100:00100000:2.0:1787134775.259099:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287870592 00000100:00100000:2.0:1787134775.259201:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:2.0:1787134775.259215:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+33:11389:x1873946287870592:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787134775.259821:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+34:11389:x1873946287870592:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 607us (1269us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787134775.259830:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:1.0:1787134775.350966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134775.351088:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287870848 00000100:00100000:0.0:1787134775.351097:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287870848 00000100:00100000:0.0:1787134775.351229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 149 00000100:00100000:0.0:1787134775.351241:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+34:11399:x1873946287870848:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134775.351266:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134775.351286:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704f5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134775.351610:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787134775.351805:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906820 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704f5 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.351817:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cc00) 00010000:00010000:0.0:1787134775.351819:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787134775.351823:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704f5 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.351912:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451400, rc 0) 00000100:00100000:0.0:1787134775.352000:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+35:11399:x1873946287870848:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 763us (1043us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787134775.352006:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 149 00000100:00100000:3.0:1787134775.360703:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134775.362817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287870976 00000100:00100000:0.0:1787134775.362831:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287870976 00000100:00100000:0.0:1787134775.362890:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 150 00000100:00100000:0.0:1787134775.362898:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+35:11399:x1873946287870976:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:0.0:1787134775.362969:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.362984:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363008:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363019:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363024:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363028:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363121:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363129:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363135:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787134775.363208:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363335:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363340:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363345:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363357:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134775.363361:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363366:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363528:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134775.363532:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134775.363535:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363540:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae90682e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363549:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363553:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363557:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363559:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134775.363561:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363564:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363576:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa44db2700) 00010000:00010000:0.0:1787134775.363578:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134775.363579:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363584:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363599:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363605:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363610:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363614:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134775.363617:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363623:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363749:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134775.363751:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134775.363754:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.363757:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90683c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134775.363910:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+35:11399:x1873946287870976:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1011us (3218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134775.363917:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 150 00000100:00100000:1.0:1787134775.372699:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134775.372747:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287871232 00000100:00100000:0.0:1787134775.372758:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287871232 00000100:00100000:0.0:1787134775.372816:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:0.0:1787134775.372824:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+35:11399:x1873946287871232:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134775.373102:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+36:11399:x1873946287871232:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 277us (412us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787134775.373110:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:1.0:1787134775.429936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.430059:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287871488 00000100:00100000:2.0:1787134775.430071:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287871488 00000100:00100000:0.0:1787134775.432960:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 151 00000100:00100000:0.0:1787134775.432980:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+36:11402:x1873946287871488:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134775.433019:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134775.433043:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906843 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90704fc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433128:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433144:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433156:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433190:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433220:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433230:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433369:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433379:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433385:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134775.433397:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787134775.433501:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433509:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433515:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433520:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134775.433526:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433534:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433557:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134775.433560:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134775.433565:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433571:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae90684a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433585:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433591:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433595:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433600:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134775.433603:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433608:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433615:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa44db2700) 00010000:00010000:0.0:1787134775.433617:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134775.433620:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433625:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433691:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906843 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704fc expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433705:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704fc expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.433712:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134775.433714:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134775.433717:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451600, rc 0) 00000100:00100000:0.0:1787134775.433791:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+38:11402:x1873946287871488:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 819us (3866us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787134775.433799:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 151 00000100:00100000:3.0:1787134775.438256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.438560:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287871616 00000100:00100000:2.0:1787134775.438570:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287871616 00000100:00100000:2.0:1787134775.438659:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 152 00000100:00100000:2.0:1787134775.438674:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+38:11402:x1873946287871616:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787134775.438740:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.438769:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.438781:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.438808:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.438814:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.438820:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.438825:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134775.438830:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.438836:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.438847:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134775.438850:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134775.438854:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.438860:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134775.438936:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+38:11402:x1873946287871616:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 268us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134775.438949:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 152 00000100:00100000:1.0:1787134775.443293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.443549:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287871872 00000100:00100000:2.0:1787134775.443562:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287871872 00000100:00100000:2.0:1787134775.443625:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:2.0:1787134775.443655:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+38:11402:x1873946287871872:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787134775.443905:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+39:11402:x1873946287871872:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 252us (631us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787134775.443914:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:2.0:1787134775.699858:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.699910:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287872128 00000100:00100000:2.0:1787134775.699921:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287872128 00000100:00100000:2.0:1787134775.699980:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 153 00000100:00100000:2.0:1787134775.699992:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+39:11433:x1873946287872128:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:2.0:1787134775.700017:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134775.700041:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90686d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070503 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.700154:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906874 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.700192:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906874 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.700205:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906874 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134775.700221:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787134775.700494:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae90686d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070503 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.700514:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906874 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070503 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134775.700524:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134775.700528:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134775.700531:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96c00, rc 0) 00000100:00100000:2.0:1787134775.700592:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+41:11433:x1873946287872128:12345-192.168.202.36@tcp:101:cat.0 Request processed in 601us (743us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787134775.700599:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 153 00000100:00100000:2.0:1787134775.709472:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134775.709509:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287872384 00000100:00100000:2.0:1787134775.709519:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287872384 00000100:00100000:2.0:1787134775.709566:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:2.0:1787134775.709576:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+41:11433:x1873946287872384:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:2.0:1787134775.709824:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+42:11433:x1873946287872384:12345-192.168.202.36@tcp:35:cat.0 Request processed in 248us (360us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787134775.709833:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:0.0:1787134775.723231:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134775.723483:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287872512 00000100:00100000:3.0:1787134775.723503:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287872512 00000100:00100000:3.0:1787134775.723562:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787134775.723571:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+42:2351:x1873946287872512:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134775.723762:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134775.723792:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906874 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070503 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.723812:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:3.0:1787134775.723817:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134775.723910:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+41:2351:x1873946287872512:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 340us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134775.723919:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000001:00080000:1.0:1787134775.727757:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000004:00080000:1.0:1787134775.727787:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:1.0:1787134775.727814:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000020:00080000:1.0:1787134775.727825:0:5858:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98aa7f749cc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787134775.727830:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa723ea900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98aa7f749480 00000020:00080000:1.0:1787134775.727833:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa723eaa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98aa743c2000 00000020:00080000:1.0:1787134775.727983:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787134775.728134:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787134775.728184:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311998336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787134775.728255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134775.729018:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311998336 00000100:00100000:0.0:1787134775.729028:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311998336 00000100:00100000:0.0:1787134775.729081:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787134775.729091:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946311998336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787134775.729118:0:6680:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787134775.729190:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a858337, atime: 0x6a858337, ctime: 0x6a858337, blocks: 0x1 00010000:00010000:0.0:1787134775.729199:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.729215:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1787134775.729219:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134775.729226:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.729262:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.729285:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.729293:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.729312:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787134775.730004:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946311998336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 911us (1745us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787134775.730012:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1787134775.730205:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa81e4f800/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787134775.730212:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311998336:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787134775.730292:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134775.730301:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.730311:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134775.730315:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.730324:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.730341:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.730347:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa468845/0x69932dacae906882 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.730371:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134775.730373:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134775.730375:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134775.744623:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134775.762603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134775.762776:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287872768 00000100:00100000:0.0:1787134775.762786:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287872768 00000100:00100000:0.0:1787134775.762845:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 154 00000100:00100000:0.0:1787134775.762856:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+19:11439:x1873946287872768:12345-192.168.202.36@tcp:101:dd.0 00010000:00010000:0.0:1787134775.762881:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134775.762885:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787134775.762912:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9067da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704d9 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.762932:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134775.762937:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787134775.762967:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906889 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907050a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.763066:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.763079:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704fc expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.763088:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.763123:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704fc expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134775.763137:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704fc expref: 19 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134775.763150:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942760700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311998464:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134775.763296:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457af000 going to sleep for 11 seconds 00000100:00100000:0.0:1787134775.766264:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942760700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311998464:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134775.766294:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134775.767110:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134775.767415:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287872896 00000100:00100000:3.0:1787134775.767422:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287872896 00010000:00010000:3.0:1787134775.767457:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704fc expref: 20 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134775.767744:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:3.0:1787134775.767755:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d63050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+20:2351:x1873946287872896:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134775.767773:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134775.767781:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704fc expref: 20 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.767795:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704fc expref: 20 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.767816:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906858 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90704fc expref: 20 pid: 5836 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.767832:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:3.0:1787134775.767837:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.767847:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.767873:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.767955:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134775.768020:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d63050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+19:2351:x1873946287872896:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 267us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134775.768028:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 63 00010000:00010000:1.0:1787134775.769980:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134775.769994:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134775.770019:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787134775.770210:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906889 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907050a expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134775.770230:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907050a expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134775.770239:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:1.0:1787134775.770241:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787134775.770258:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450600, rc 0) 00000100:00100000:1.0:1787134775.770654:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+19:11439:x1873946287872768:12345-192.168.202.36@tcp:101:dd.0 Request processed in 7799us (8066us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787134775.770664:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 154 00000100:00100000:2.0:1787134775.781101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134775.781257:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287873152 00000100:00100000:3.0:1787134775.781267:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287873152 00000100:00100000:3.0:1787134775.781350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 155 00000100:00100000:3.0:1787134775.781368:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+19:11439:x1873946287873152:12345-192.168.202.36@tcp:36:dd.0 00010000:00010000:3.0:1787134775.781657:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.781674:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.781686:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787134775.781740:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787134775.781766:0:5837:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000bf5d32a5 reply state 0000000001716a69 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134775.781775:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787134775.782022:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+22:11439:x1873946287873152:12345-192.168.202.36@tcp:36:dd.0 Request processed in 662us (930us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787134775.782029:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 155 00000020:00080000:3.0:1787134775.782033:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787134775.785053:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.785069:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.785076:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.785083:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134775.785088:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.785096:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.785112:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:3.0:1787134775.785115:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134775.785119:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134775.785126:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae90689e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134776.090127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134776.090465:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287873280 00000100:00100000:3.0:1787134776.090477:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287873280 00000100:00100000:3.0:1787134776.090563:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 156 00000100:00100000:3.0:1787134776.090575:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+21:11453:x1873946287873280:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:3.0:1787134776.090733:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134776.090755:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9068a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070511 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787134776.091054:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787134776.091073:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.091090:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.091103:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.091119:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.091126:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.091133:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.091798:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.092236:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907050a expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.092247:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.092309:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907050a expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.092338:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907050a expref: 22 pid: 5836 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134776.092354:0:11683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1873946311998592:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134776.093334:0:11683:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787134776.096816:0:11683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1873946311998592:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134776.096865:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134776.103967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.104441:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287873536 00000100:00100000:0.0:1787134776.104452:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287873536 00000100:00100000:0.0:1787134776.104522:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:0.0:1787134776.104534:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+23:9250:x1873946287873536:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787134776.104908:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+24:9250:x1873946287873536:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 375us (952us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787134776.104938:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:2.0:1787134776.115288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134776.115491:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287873664 00000100:00100000:3.0:1787134776.115505:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287873664 00010000:00010000:3.0:1787134776.115552:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907050a expref: 24 pid: 5836 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134776.115612:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:3.0:1787134776.115623:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+24:2351:x1873946287873664:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134776.115649:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134776.115656:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907050a expref: 24 pid: 5836 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.115671:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907050a expref: 24 pid: 5836 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.115696:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906890 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907050a expref: 24 pid: 5836 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.115734:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:3.0:1787134776.115740:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.115749:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.115758:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.115791:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134776.115864:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+23:2351:x1873946287873664:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 243us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134776.115872:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 64 00010000:00010000:2.0:1787134776.116213:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116230:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134776.116281:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787134776.116286:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134776.116325:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116340:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116350:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116357:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116363:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116370:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134776.116375:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116384:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116405:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134776.116409:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134776.116413:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116431:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9068ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116444:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116450:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116456:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116461:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7bc00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134776.116464:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116471:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116480:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa42a7c200) 00010000:00010000:2.0:1787134776.116483:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134776.116486:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116492:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9068b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116533:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9068a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070511 expref: 23 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116560:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070511 expref: 22 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.116568:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134776.116571:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134776.116573:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b800, rc 0) 00000100:00100000:2.0:1787134776.116617:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+22:11453:x1873946287873280:12345-192.168.202.36@tcp:101:stat.0 Request processed in 26046us (26500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134776.116635:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 156 00000100:00100000:3.0:1787134776.219020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134776.219122:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287873920 00000100:00100000:1.0:1787134776.219132:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287873920 00000100:00100000:1.0:1787134776.219233:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 157 00000100:00100000:1.0:1787134776.219253:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+22:11459:x1873946287873920:12345-192.168.202.36@tcp:36:truncate.0 00010000:00010000:1.0:1787134776.219312:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134776.219339:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae9068ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070511 expref: 22 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.219358:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:1.0:1787134776.219364:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134776.219570:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.219597:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.219608:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787134776.219669:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787134776.219695:0:5836:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000bfaa5386 reply state 000000000155d344 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134776.219704:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787134776.219797:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+24:11459:x1873946287873920:12345-192.168.202.36@tcp:36:truncate.0 Request processed in 554us (788us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787134776.219818:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 157 00000020:00080000:1.0:1787134776.219824:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787134776.222368:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.222387:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.222394:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.222399:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134776.222404:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.222412:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.222431:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:1.0:1787134776.222434:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134776.222440:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.222445:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae9068c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134776.378672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.378793:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287874048 00000100:00100000:0.0:1787134776.378805:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287874048 00000100:00100000:0.0:1787134776.378873:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 158 00000100:00100000:0.0:1787134776.378884:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+23:11473:x1873946287874048:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:0.0:1787134776.378910:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134776.379055:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae9068c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070518 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379123:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379139:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379151:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379205:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379213:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379220:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379562:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379581:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379589:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134776.379637:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787134776.379642:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134776.379667:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379679:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379687:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379694:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379700:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379706:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134776.379710:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379718:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379731:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134776.379740:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134776.379745:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379752:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9068cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379765:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379771:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379777:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379782:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134776.379785:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379791:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379799:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa531ac000) 00010000:00010000:0.0:1787134776.379801:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134776.379804:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379810:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9068d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379840:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae9068c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070518 expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379866:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070518 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.379874:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134776.379876:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134776.379878:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450c00, rc 0) 00000100:00100000:0.0:1787134776.380675:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+24:11473:x1873946287874048:12345-192.168.202.36@tcp:101:stat.0 Request processed in 1788us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134776.380685:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 158 00000100:00100000:0.0:1787134776.455461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134776.455695:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287874304 00000100:00100000:2.0:1787134776.455706:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287874304 00000100:00100000:2.0:1787134776.455766:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 159 00000100:00100000:2.0:1787134776.455776:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+24:11483:x1873946287874304:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134776.455797:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134776.455818:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9068e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907051f expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134776.456087:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787134776.456367:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9068e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907051f expref: 26 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.456382:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cc00) 00010000:00010000:2.0:1787134776.456385:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134776.456390:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9068e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907051f expref: 26 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.456417:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96e00, rc 0) 00000100:00100000:2.0:1787134776.456519:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+25:11483:x1873946287874304:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 744us (1067us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787134776.456527:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 159 00000100:00100000:3.0:1787134776.460031:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.460109:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287874560 00000100:00100000:0.0:1787134776.460120:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287874560 00000100:00100000:0.0:1787134776.460200:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:0.0:1787134776.460211:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa50e42050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+25:11483:x1873946287874560:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134776.460975:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa50e42050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+26:11483:x1873946287874560:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 762us (948us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787134776.460985:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:3.0:1787134776.540322:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134776.540484:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287874816 00000100:00100000:2.0:1787134776.540494:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287874816 00000100:00100000:2.0:1787134776.540554:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 160 00000100:00100000:2.0:1787134776.540566:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+26:11489:x1873946287874816:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134776.540591:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134776.540611:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9068f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070526 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.540728:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.540744:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070518 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.540753:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.540795:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070518 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.540808:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070518 expref: 27 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134776.540842:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946311998720:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134776.540950:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749900 going to sleep for 11 seconds 00000100:00100000:0.0:1787134776.543430:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946311998720:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134776.543463:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134776.544052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.544135:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287874944 00000100:00100000:0.0:1787134776.544142:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287874944 00010000:00010000:0.0:1787134776.544223:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070518 expref: 28 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134776.544439:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:0.0:1787134776.544451:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+28:2352:x1873946287874944:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134776.544466:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134776.544473:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070518 expref: 28 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.544485:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070518 expref: 28 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.544509:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae9068dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070518 expref: 28 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.544525:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134776.544531:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.544541:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.544549:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.544686:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134776.544753:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+27:2352:x1873946287874944:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 303us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134776.544762:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 65 00010000:00010000:2.0:1787134776.546419:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.546433:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134776.546455:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787134776.546633:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae9068f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070526 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.546658:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070526 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.546668:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134776.546670:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787134776.546674:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97400, rc 0) 00000100:00100000:2.0:1787134776.548411:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+27:11489:x1873946287874816:12345-192.168.202.36@tcp:101:bash.0 Request processed in 7727us (7978us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787134776.548423:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 160 00000100:00100000:3.0:1787134776.560986:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.561202:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287875200 00000100:00100000:0.0:1787134776.561225:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287875200 00000100:00100000:0.0:1787134776.561406:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 161 00000100:00100000:0.0:1787134776.561418:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+27:11489:x1873946287875200:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:0.0:1787134776.561698:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.561717:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.561729:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787134776.561793:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787134776.561819:0:5837:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000048878a5b reply state 00000000a5d8dcf0 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134776.561829:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787134776.562345:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+30:11489:x1873946287875200:12345-192.168.202.36@tcp:36:bash.0 Request processed in 926us (1366us total) trans 4294967449 rc 0/0 00010000:00010000:2.0:1787134776.567809:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.567829:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.567837:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.567855:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134776.567871:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.567879:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.567896:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134776.567899:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134776.567904:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.567910:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906907 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134776.567922:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134776.567970:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287875328 00000100:00100000:3.0:1787134776.567981:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287875328 00000100:00100000:0.0:1787134776.569328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 161 00000020:00080000:0.0:1787134776.569337:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787134776.569635:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 162 00000100:00100000:3.0:1787134776.569651:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+29:11489:x1873946287875328:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787134776.569678:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134776.569701:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90690e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907052d expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.569805:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.569819:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070526 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.569829:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.569864:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070526 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134776.569878:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070526 expref: 30 pid: 5835 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134776.569892:0:11683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa4dafe680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1873946311998848:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134776.569986:0:11683:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787134776.576551:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.576698:0:11683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa4dafe680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1873946311998848:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134776.576727:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134776.576940:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287875456 00000100:00100000:1.0:1787134776.576952:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287875456 00010000:00010000:1.0:1787134776.577112:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070526 expref: 31 pid: 5835 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134776.577453:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00100000:1.0:1787134776.577476:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+31:2351:x1873946287875456:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134776.577495:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134776.577504:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070526 expref: 31 pid: 5835 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.577517:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070526 expref: 31 pid: 5835 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.577542:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae9068f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070526 expref: 31 pid: 5835 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.577558:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:1.0:1787134776.577562:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.577571:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.577579:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.577879:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134776.577954:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+30:2351:x1873946287875456:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 482us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134776.577963:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 66 00010000:00010000:0.0:1787134776.582701:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.582719:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134776.582803:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787134776.582808:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134776.582829:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.583062:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90690e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907052d expref: 30 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.583084:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907052d expref: 29 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.583092:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134776.583095:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134776.583098:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b800, rc 0) 00000100:00100000:0.0:1787134776.583188:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+29:11489:x1873946287875328:12345-192.168.202.36@tcp:101:bash.0 Request processed in 13543us (15269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134776.583198:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 162 00000100:00100000:2.0:1787134776.586285:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134776.586429:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287875712 00000100:00100000:1.0:1787134776.586449:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287875712 00000100:00100000:1.0:1787134776.586522:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:1.0:1787134776.586533:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+29:11489:x1873946287875712:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:1.0:1787134776.586809:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+30:11489:x1873946287875712:12345-192.168.202.36@tcp:35:bash.0 Request processed in 278us (532us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787134776.586818:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:2.0:1787134776.688045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.688154:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287875968 00000100:00100000:0.0:1787134776.688208:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287875968 00000100:00100000:0.0:1787134776.688272:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 163 00000100:00100000:0.0:1787134776.688282:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+30:11499:x1873946287875968:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134776.688308:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134776.688330:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90691c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070534 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134776.688583:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787134776.688756:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90691c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070534 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.688777:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cc00) 00010000:00010000:0.0:1787134776.688780:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787134776.688785:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90691c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070534 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.688800:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450000, rc 0) 00000100:00100000:0.0:1787134776.688871:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+31:11499:x1873946287875968:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 591us (836us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787134776.688878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 163 00000100:00100000:3.0:1787134776.692279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.692685:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287876096 00000100:00100000:0.0:1787134776.692696:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287876096 00000100:00100000:0.0:1787134776.692752:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 164 00000100:00100000:0.0:1787134776.692762:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+31:11499:x1873946287876096:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:0.0:1787134776.692846:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.692863:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.692875:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.692890:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.692896:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.692922:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.693538:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.693549:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.693556:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787134776.693969:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.693983:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.693989:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.693995:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694001:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134776.694005:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694012:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694025:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134776.694034:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134776.694039:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694046:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90692a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694060:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694065:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694071:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694076:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134776.694079:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694084:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694091:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa531ac000) 00010000:00010000:0.0:1787134776.694093:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134776.694096:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694101:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906931 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694114:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694125:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694131:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694136:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134776.694139:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694145:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694152:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134776.694155:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134776.694265:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.694273:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906938 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134776.694365:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+31:11499:x1873946287876096:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1601us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134776.694373:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 164 00000100:00100000:2.0:1787134776.703274:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.703441:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287876352 00000100:00100000:0.0:1787134776.703454:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287876352 00000100:00100000:0.0:1787134776.703535:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:0.0:1787134776.703547:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+31:11499:x1873946287876352:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134776.704063:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+32:11499:x1873946287876352:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 517us (807us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787134776.704079:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:1.0:1787134776.751801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.751895:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287876608 00000100:00100000:0.0:1787134776.751905:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287876608 00000100:00100000:0.0:1787134776.751966:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 165 00000100:00100000:0.0:1787134776.751977:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+32:11502:x1873946287876608:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134776.752000:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134776.752023:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90693f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907053b expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.752126:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.752142:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.752154:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.752209:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.752217:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.752223:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754342:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754361:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754371:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134776.754383:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787134776.754477:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754492:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754499:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754505:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134776.754509:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754517:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754530:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134776.754533:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134776.754537:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754543:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906946 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754555:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754561:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754567:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754572:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134776.754670:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754677:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754686:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa531ac000) 00010000:00010000:2.0:1787134776.754688:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134776.754692:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754697:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae90694d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754749:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae90693f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907053b expref: 35 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754764:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907053b expref: 34 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.754771:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:2.0:1787134776.754773:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134776.754776:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97000, rc 0) 00000100:00100000:2.0:1787134776.754859:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+34:11502:x1873946287876608:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 2884us (3067us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787134776.754869:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 165 00000100:00100000:3.0:1787134776.767359:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134776.769663:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287876736 00000100:00100000:1.0:1787134776.769679:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287876736 00000100:00100000:1.0:1787134776.769753:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 166 00000100:00100000:1.0:1787134776.769764:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+34:11502:x1873946287876736:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:1.0:1787134776.769837:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.769856:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.769867:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.769894:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.769902:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.769910:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.769916:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134776.769935:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.769944:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.769956:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:1.0:1787134776.769959:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134776.769964:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.769970:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906962 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134776.770061:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+34:11502:x1873946287876736:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 298us (2711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134776.770070:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 166 00010000:00010000:3.0:1787134776.771843:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134776.773225:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134776.773373:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287876992 00000100:00100000:1.0:1787134776.773383:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287876992 00000100:00100000:1.0:1787134776.773439:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:1.0:1787134776.773449:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+34:11502:x1873946287876992:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787134776.773721:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+35:11502:x1873946287876992:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 273us (504us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787134776.773730:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:3.0:1787134776.776318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134776.776449:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287877120 00000100:00100000:1.0:1787134776.776459:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287877120 00000100:00100000:1.0:1787134776.776521:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:1.0:1787134776.776531:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa74249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+35:2349:x1873946287877120:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134776.776554:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134776.776602:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907053b expref: 35 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.776631:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:1.0:1787134776.776636:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134776.776687:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa74249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+34:2349:x1873946287877120:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 158us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134776.776695:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:3.0:1787134776.912837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.912967:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287877376 00000100:00100000:0.0:1787134776.912978:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287877376 00000100:00100000:0.0:1787134776.913085:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 167 00000100:00100000:0.0:1787134776.913110:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+34:11520:x1873946287877376:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:0.0:1787134776.913140:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134776.913189:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070542 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.913427:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906970 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.913445:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.913457:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134776.913469:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787134776.913694:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070542 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.913715:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906970 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070542 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.913725:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:0.0:1787134776.913728:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787134776.913732:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451a00, rc 0) 00000100:00100000:0.0:1787134776.913836:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+36:11520:x1873946287877376:12345-192.168.202.36@tcp:101:cat.0 Request processed in 728us (1010us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787134776.913843:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 167 00000100:00100000:3.0:1787134776.936775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134776.936858:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287877504 00000100:00100000:2.0:1787134776.936869:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287877504 00000100:00100000:2.0:1787134776.936928:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00100000:2.0:1787134776.936939:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+36:11521:x1873946287877504:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134776.936975:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134776.936997:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90697e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070549 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.937067:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906985 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.937082:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.937093:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134776.937301:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787134776.937305:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134776.937369:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.937395:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90697e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070549 expref: 38 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.937411:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906985 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070549 expref: 37 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.937420:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134776.937423:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787134776.937426:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96000, rc 0) 00000100:00100000:2.0:1787134776.937609:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+37:11521:x1873946287877504:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 671us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134776.937616:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00100000:3.0:1787134776.942211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.942297:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287877888 00000100:00100000:0.0:1787134776.942306:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287877888 00000100:00100000:0.0:1787134776.942378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:0.0:1787134776.942389:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+37:11521:x1873946287877888:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134776.943086:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+38:11521:x1873946287877888:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 696us (881us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787134776.943095:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:3.0:1787134776.946186:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134776.946279:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287878016 00000100:00100000:1.0:1787134776.946288:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287878016 00000100:00100000:1.0:1787134776.946354:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:1.0:1787134776.946365:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+38:11521:x1873946287878016:12345-192.168.202.36@tcp:103:lfs.0 00010000:00010000:1.0:1787134776.946381:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787134776.946408:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906915 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907052d expref: 38 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.946428:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906970 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070542 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.946439:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704ee expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134776.946449:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa44db2e00) 00010000:00010000:1.0:1787134776.946460:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134776.946803:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+35:11521:x1873946287878016:12345-192.168.202.36@tcp:103:lfs.0 Request processed in 139us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134776.946814:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:1.0:1787134776.949668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134776.949790:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287878144 00000100:00100000:2.0:1787134776.949799:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287878144 00000100:00100000:2.0:1787134776.949892:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 169 00000100:00100000:2.0:1787134776.949904:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+35:11521:x1873946287878144:12345-192.168.202.36@tcp:58:lfs.0 00010000:00010000:2.0:1787134776.950008:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.950026:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134776.950039:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787134776.950710:0:11472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787134776.950795:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+35:11521:x1873946287878144:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 893us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134776.950803:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 169 00000100:00100000:2.0:1787134776.976671:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134776.976811:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287878272 00000100:00100000:0.0:1787134776.976822:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287878272 00000100:00100000:0.0:1787134776.976882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 170 00000100:00100000:0.0:1787134776.976893:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+35:11523:x1873946287878272:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134776.976914:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134776.976935:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906993 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070550 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977004:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977020:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977031:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977046:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977052:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977058:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977477:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977487:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977493:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134776.977530:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787134776.977534:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134776.977555:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977566:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977655:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977662:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977668:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977675:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134776.977679:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977687:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977711:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134776.977714:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134776.977719:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977725:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae90699a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977738:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977744:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977749:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977754:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134776.977757:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977763:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977770:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa531ac300) 00010000:00010000:0.0:1787134776.977772:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134776.977775:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977780:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae9069a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977822:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906993 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070550 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977837:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070550 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134776.977844:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:0.0:1787134776.977846:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787134776.977849:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451a00, rc 0) 00000100:00100000:0.0:1787134776.977922:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+36:11523:x1873946287878272:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1030us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134776.977930:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 170 00000100:00100000:2.0:1787134777.730711:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787134777.730734:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311998976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134777.730815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134777.730972:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311998976 00000100:00100000:0.0:1787134777.730981:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311998976 00000100:00100000:0.0:1787134777.731047:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787134777.731057:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946311998976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787134777.731093:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134777.731142:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946311998976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134777.731150:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1787134777.731307:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134777.731347:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946311998976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787134777.793505:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787134777.861934:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787134777.861948:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787134777.862030:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787134777.862040:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787134777.862249:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946311999104:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787134777.862409:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f7493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134777.869813:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946311999104:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787134777.870082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134777.870605:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287878400 00000100:00100000:0.0:1787134777.870625:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287878400 00000100:00100000:0.0:1787134777.870716:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 171 00000100:00100000:0.0:1787134777.870729:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+36:11534:x1873946287878400:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787134777.870783:0:11683:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787134777.870959:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+36:11534:x1873946287878400:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 231us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134777.870968:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 171 00000100:00100000:0.0:1787134777.879289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134777.879717:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287878528 00000100:00100000:2.0:1787134777.879731:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287878528 00000100:00100000:2.0:1787134777.879801:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:2.0:1787134777.879812:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+36:11534:x1873946287878528:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787134777.879907:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.879927:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.879940:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.879956:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.879964:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.879971:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.879999:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880007:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880013:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134777.880077:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787134777.880082:0:11472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134777.880097:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880110:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880117:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880125:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880132:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134777.880137:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880145:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880183:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:2.0:1787134777.880186:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134777.880191:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880197:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97200/0x69932dacae9069af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880213:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880229:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880235:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880240:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134777.880243:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880249:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880256:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff98aa59e99f00) 00010000:00010000:2.0:1787134777.880258:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134777.880261:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880267:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae9069b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880282:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880288:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880294:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880299:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134777.880306:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880313:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880319:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:2.0:1787134777.880321:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134777.880324:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.880329:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae9069bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134777.880930:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+36:11534:x1873946287878528:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 1115us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134777.880940:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:1.0:1787134777.895625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134777.895716:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287878784 00000100:00100000:2.0:1787134777.895732:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287878784 00000100:00100000:2.0:1787134777.895817:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:2.0:1787134777.895831:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+36:11534:x1873946287878784:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134777.895864:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134777.895893:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9069c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070557 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896037:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896057:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896083:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134777.896100:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787134777.896284:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896293:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896300:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896308:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134777.896313:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896322:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896339:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:2.0:1787134777.896343:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787134777.896588:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896597:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae9069cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896670:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9069c4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070557 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896697:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:2.0:1787134777.896700:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134777.896705:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae9069c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070557 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.896719:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96c00, rc 0) 00000100:00100000:2.0:1787134777.896821:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+37:11534:x1873946287878784:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 993us (1221us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787134777.896831:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:0.0:1787134777.903706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134777.903839:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287878912 00000100:00100000:2.0:1787134777.903854:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287878912 00000100:00100000:2.0:1787134777.903961:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 174 00000100:00100000:2.0:1787134777.903974:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+37:11534:x1873946287878912:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787134777.904024:0:11683:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787134777.904187:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+37:11534:x1873946287878912:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 216us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134777.904197:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 174 00000100:00100000:0.0:1787134777.916548:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134777.916623:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287879168 00000100:00100000:0.0:1787134777.916636:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287879168 00000100:00100000:0.0:1787134777.916705:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 175 00000100:00100000:0.0:1787134777.916718:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+37:11534:x1873946287879168:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134777.916750:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134777.916755:0:11472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787134777.916795:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906985 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070549 expref: 37 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134777.916817:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134777.916823:0:11472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787134777.916841:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9069d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907055e expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787134777.917844:0:11472:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787134777.918195:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9069e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134777.918213:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9069e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134777.918225:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9069e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134777.918309:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae9069d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907055e expref: 39 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134777.918328:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9069e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907055e expref: 38 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134777.918337:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa531ac300) 00010000:00010000:0.0:1787134777.918340:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134777.918342:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451e00, rc 0) 00000100:00100000:0.0:1787134777.918425:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+38:11534:x1873946287879168:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1709us (1892us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787134777.918434:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 175 00000040:00080000:1.0:1787134777.930267:0:12506:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787134777.930281:0:12506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787134777.930320:0:12506:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787134777.930327:0:12506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787134777.930804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134777.930928:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287879424 00000100:00100000:3.0:1787134777.930944:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287879424 00000100:00100000:3.0:1787134777.931021:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 176 00000100:00100000:3.0:1787134777.931033:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+38:11534:x1873946287879424:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787134777.931119:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134777.931178:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9069e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907055e expref: 38 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931200:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa531ac300) 00010000:00010000:3.0:1787134777.931214:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787134777.931244:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931263:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931276:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931291:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931299:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931306:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931642:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931663:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931671:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931678:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134777.931683:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931692:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931702:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:3.0:1787134777.931706:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134777.931711:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931717:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9069ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931728:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931735:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931742:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931748:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7bc00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134777.931757:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931764:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931774:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x917b2e02 (ffff98aa42a7ca00) 00010000:00010000:3.0:1787134777.931777:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134777.931780:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.931786:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7bc00/0x69932dacae9069f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x917b2e02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134777.931891:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+37:11534:x1873946287879424:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 858us (1094us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787134777.931899:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 176 00000100:00100000:0.0:1787134777.934095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134777.934200:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287879552 00000100:00100000:3.0:1787134777.934213:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287879552 00000100:00100000:3.0:1787134777.934273:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 177 00000100:00100000:3.0:1787134777.934285:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+37:11534:x1873946287879552:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134777.934311:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134777.934343:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9069fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070565 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.934390:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.934407:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.934432:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.934552:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae9069fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070565 expref: 39 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.934586:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070565 expref: 38 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134777.934595:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:3.0:1787134777.934598:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787134777.934602:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b800, rc 0) 00000100:00100000:3.0:1787134777.934676:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+38:11534:x1873946287879552:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 393us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134777.934684:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 177 00000100:00100000:1.0:1787134777.943607:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134777.944035:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287879808 00000100:00100000:2.0:1787134777.944050:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287879808 00000100:00100000:2.0:1787134777.944266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 178 00000100:00100000:2.0:1787134777.944279:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+38:11534:x1873946287879808:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787134777.944566:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.944587:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134777.944607:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787134777.945125:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787134777.945138:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393911979044ns, next at 394911975476ns, rc = 0 00000004:00010000:2.0:1787134777.945291:0:5835:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000d156cf8d reply state 00000000033685ef transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134777.945308:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134777.945659:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+40:11534:x1873946287879808:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 1379us (2061us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787134777.945791:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 178 00010000:00010000:1.0:1787134777.947341:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134777.947357:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134777.947365:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134777.947371:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134777.947377:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134777.947386:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134777.947408:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:1.0:1787134777.947412:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787134777.947417:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134777.947424:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906a0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134777.952487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134777.954669:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287879936 00000100:00100000:1.0:1787134777.954686:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287879936 00000100:00100000:1.0:1787134777.954781:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 179 00000100:00100000:1.0:1787134777.954794:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+39:11534:x1873946287879936:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787134777.954829:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134777.954855:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907056c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134777.954934:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907056c expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134777.954952:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907056c expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134777.954977:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:1.0:1787134777.954981:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787134777.954986:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6000, rc 0) 00000100:00100000:1.0:1787134777.955076:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+40:11534:x1873946287879936:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 285us (2614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134777.955085:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 179 00000100:00100000:0.0:1787134777.963402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134777.963548:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287880064 00000100:00100000:2.0:1787134777.963572:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287880064 00000100:00100000:2.0:1787134777.963683:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:2.0:1787134777.963696:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287880064:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787134777.964450:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+7:2352:x1873946287880064:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 755us (1062us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787134777.964461:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00080000:1.0:1787134777.966330:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134777.979472:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134777.979655:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287880320 00000100:00100000:2.0:1787134777.979682:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287880320 00000100:00100000:2.0:1787134777.979773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:2.0:1787134777.979787:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+40:11534:x1873946287880320:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787134777.980203:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+41:11534:x1873946287880320:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 418us (751us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787134777.980212:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:3.0:1787134777.986076:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134777.986291:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287880576 00000100:00100000:0.0:1787134777.986309:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287880576 00000100:00100000:0.0:1787134777.986435:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 180 00000100:00100000:0.0:1787134777.986451:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+41:11534:x1873946287880576:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787134777.986656:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+41:11534:x1873946287880576:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 207us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134777.986674:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 180 00000100:00100000:1.0:1787134778.002716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134778.002878:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287880704 00000100:00100000:0.0:1787134778.002893:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287880704 00000100:00100000:0.0:1787134778.003004:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 181 00000100:00100000:0.0:1787134778.003018:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+41:11534:x1873946287880704:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134778.003049:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134778.003079:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070573 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.003210:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906a1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.003229:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.003242:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134778.003293:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134778.003317:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.003351:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070573 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.003373:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070573 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.003384:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:0.0:1787134778.003387:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787134778.003392:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451e00, rc 0) 00000100:00100000:0.0:1787134778.003473:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+42:11534:x1873946287880704:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 457us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134778.003506:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 181 00000100:00080000:1.0:1787134778.004054:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134778.020782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134778.021226:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287880832 00000100:00100000:2.0:1787134778.021240:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287880832 00000100:00100000:2.0:1787134778.021317:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:2.0:1787134778.021330:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287880832:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134778.021353:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134778.021382:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907057a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787134778.021420:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a85833a, blocks: 0x1 00010000:00010000:2.0:1787134778.021447:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787134778.021453:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134778.021464:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907057a expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134778.021486:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907057a expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134778.021513:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96a00, rc 0) 00000100:00100000:2.0:1787134778.021601:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287880832:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 275us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134778.021617:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:1.0:1787134778.026699:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134778.027233:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287881088 00000100:00100000:3.0:1787134778.027247:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287881088 00000100:00100000:3.0:1787134778.027320:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 182 00000100:00100000:3.0:1787134778.027334:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+42:11534:x1873946287881088:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787134778.027511:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+42:11534:x1873946287881088:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 179us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134778.027521:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 182 00000100:00100000:1.0:1787134778.042116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134778.042293:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287881216 00000100:00100000:3.0:1787134778.042308:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287881216 00000100:00100000:3.0:1787134778.042391:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:3.0:1787134778.042402:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+8:11534:x1873946287881216:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134778.042428:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134778.042458:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070581 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.042502:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907057a expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.042514:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787134778.042519:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134778.042527:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.042593:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907057a expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.042621:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907057a expref: 9 pid: 6682 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134778.042639:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94278b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1873946311999232:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134778.042760:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134778.045815:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94278b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1873946311999232:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134778.045867:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.045915:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59debc00, rc 0) 00000100:00100000:3.0:1787134778.045986:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+9:11534:x1873946287881216:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 3587us (3885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134778.045997:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:1.0:1787134778.048333:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134778.048661:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287881344 00000100:00100000:3.0:1787134778.048676:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287881344 00010000:00010000:3.0:1787134778.048733:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907057a expref: 9 pid: 6682 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134778.048788:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:3.0:1787134778.048800:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287881344:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134778.048821:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134778.048853:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907057a expref: 9 pid: 6682 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.048868:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907057a expref: 9 pid: 6682 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.048900:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b49f53c/0x69932dacae906a26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907057a expref: 9 pid: 6682 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.048922:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134778.048927:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134778.048937:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.048969:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.049015:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134778.049031:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94278b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1873946311999360:192.168.202.36@tcp:105: 00000100:00100000:3.0:1787134778.049130:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134778.056537:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134778.056592:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287881472 00000100:00100000:1.0:1787134778.056604:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287881472 00002000:00100000:1.0:1787134778.056693:0:6687:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98aa81e4c700 x1873946287881472/t0(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:714/0 lens 504/0 e 0 to 0 dl 1787134789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787134778.056717:0:6687:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa81e4c700 with x1873946287881472 ext(0->8) 00002000:00010000:1.0:1787134778.056724:0:6687:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa81e4c700 00000100:00100000:1.0:1787134778.056763:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787134778.056773:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486fb1ad-4266-4864-b299-111c5140734b+9:2351:x1873946287881472:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787134778.056779:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94278b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1873946311999360:192.168.202.36@tcp:105: 00010000:00010000:3.0:1787134778.056807:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134778.056872:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287881344:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 8074us (8551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134778.056883:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:1.0:1787134778.057370:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486fb1ad-4266-4864-b299-111c5140734b+10:2351:x1873946287881472:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 Request processed in 596us (849us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787134778.057378:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00002000:00100000:1.0:1787134778.057386:0:6687:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98aa81e4c700 x1873946287881472/t4294967314(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:714/0 lens 504/448 e 0 to 0 dl 1787134789 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787134778.057396:0:6687:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa81e4c700 with x1873946287881472 ext(0->8) 00002000:00010000:1.0:1787134778.057400:0:6687:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa81e4c700 00000100:00100000:1.0:1787134778.060916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134778.061199:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287881600 00000100:00100000:2.0:1787134778.061214:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287881600 00000100:00100000:2.0:1787134778.061296:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 183 00000100:00100000:2.0:1787134778.061308:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+42:11534:x1873946287881600:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787134778.107029:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:1.0:1787134778.107100:0:5858:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1787134778.107113:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787134778.107123:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1787134778.107188:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787134778.107200:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787134778.107882:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+18:11534:x1873946287881600:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 46567us (46977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134778.107896:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 183 00000100:00100000:1.0:1787134778.108327:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311999488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787134778.108437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134778.108648:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946311999488 00000100:00100000:3.0:1787134778.108666:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946311999488 00000100:00080000:1.0:1787134778.108905:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134778.109066:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787134778.109078:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946311999488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787134778.109328:0:7839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787134778.109332:0:7839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787134778 00002000:00010000:3.0:1787134778.109335:0:7839:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787134778.109338:0:7839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787134778 -> 1787134778 00002000:00010000:3.0:1787134778.109349:0:7839:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787134778.109404:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946311999488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 328us (967us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787134778.109412:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787134778.109539:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa81e4f480/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787134778.109546:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946311999488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787134778.119983:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134778.120335:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287881728 00000100:00100000:3.0:1787134778.120511:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287881728 00000100:00100000:3.0:1787134778.120635:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:3.0:1787134778.120647:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+10:2352:x1873946287881728:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787134778.256668:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1787134778.257089:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+8:2352:x1873946287881728:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 136433us (137107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134778.257106:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 55 00000001:00080000:3.0:1787134778.257183:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1787134778.264018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134778.264115:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287881984 00000100:00100000:2.0:1787134778.264133:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287881984 00000100:00100000:2.0:1787134778.264269:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 184 00000100:00100000:2.0:1787134778.264282:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+18:11534:x1873946287881984:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787134778.264374:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134778.264418:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae906a1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070573 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134778.264441:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:2.0:1787134778.264447:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134778.264490:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134778.264507:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134778.264518:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787134778.265940:0:5837:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000001e65a68f reply state 000000007b02116a transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134778.265961:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134778.266132:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+19:11534:x1873946287881984:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 1848us (2127us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787134778.266143:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 184 00010000:00010000:3.0:1787134778.273286:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.273313:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.273323:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.273330:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134778.273337:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.273357:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.273383:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:3.0:1787134778.273387:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134778.273422:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.273430:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906a34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134778.274565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134778.274897:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287882112 00000100:00100000:0.0:1787134778.274912:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287882112 00000100:00100000:0.0:1787134778.275001:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:0.0:1787134778.275016:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+7:2352:x1873946287882112:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787134778.275840:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787134778.275847:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787134778 -> 1787134777 00002000:00010000:0.0:1787134778.275849:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787134775 00002000:00010000:0.0:1787134778.275852:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787134778 -> 1787134777 00002000:00010000:0.0:1787134778.275855:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787134778.275990:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+8:2352:x1873946287882112:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 975us (1432us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787134778.276001:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:2.0:1787134778.281337:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134778.281461:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287882368 00000100:00100000:0.0:1787134778.281477:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287882368 00000100:00100000:0.0:1787134778.281566:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 185 00000100:00100000:0.0:1787134778.281581:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+18:11534:x1873946287882368:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787134778.281718:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.281740:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070565 expref: 18 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.281748:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.281821:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070565 expref: 18 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.281837:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070565 expref: 18 pid: 11683 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134778.281854:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311999616:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134778.281979:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa48019180 going to sleep for 11 seconds 00000100:00100000:2.0:1787134778.288498:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134778.288656:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1873946311999616:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134778.288704:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134778.290312:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287882496 00000100:00100000:1.0:1787134778.290327:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287882496 00010000:00010000:1.0:1787134778.290393:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070565 expref: 19 pid: 11683 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134778.290446:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:1.0:1787134778.290458:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+19:2351:x1873946287882496:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134778.290481:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134778.290490:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070565 expref: 19 pid: 11683 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.290507:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070565 expref: 19 pid: 11683 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.290539:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae906a03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070565 expref: 19 pid: 11683 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.290564:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:1.0:1787134778.290571:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.290618:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.290629:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.290658:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787134778.290685:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.290694:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.290737:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.290745:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134778.290745:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+18:2351:x1873946287882496:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 289us (2269us total) trans 0 rc 0/0 00010000:00010000:3.0:1787134778.290753:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134778.290754:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 68 00010000:00010000:3.0:1787134778.290760:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134778.290766:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.290774:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.290795:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:3.0:1787134778.290798:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787134778.290802:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.290808:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906a3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134778.290857:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+17:11534:x1873946287882368:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 Request processed in 9280us (9538us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787134778.290867:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 185 00000100:00100000:2.0:1787134778.294262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134778.294377:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287882624 00000100:00100000:1.0:1787134778.294392:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287882624 00000100:00100000:1.0:1787134778.294465:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:1.0:1787134778.294478:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+8:2350:x1873946287882624:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787134778.294546:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.294576:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.294586:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134778.294591:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134778.294597:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.294654:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.294696:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 8 pid: 6681 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134778.294870:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a941b15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1873946311999744:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134778.294984:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa5075b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134778.300325:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a941b15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1873946311999744:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134778.300479:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134778.307082:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134778.307222:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287882752 00000100:00100000:1.0:1787134778.307236:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287882752 00010000:00010000:1.0:1787134778.307302:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 9 pid: 6681 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134778.307803:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:3.0:1787134778.307819:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287882752:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134778.307841:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134778.307875:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 9 pid: 6681 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.307893:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 9 pid: 6681 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.307924:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021c383d3/0x69932dacae906a2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070581 expref: 9 pid: 6681 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.307946:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787134778.307951:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787134778.307958:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.307980:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.308023:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134778.308096:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+8:2352:x1873946287882752:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 282us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134778.308105:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 69 00010000:00010000:0.0:1787134778.309011:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.309029:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.309066:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.309076:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.309085:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.309094:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134778.309099:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.309122:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.309140:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.309149:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016c1b798/0x69932dacae906a42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134778.309271:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2350:x1873946287882624:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 14794us (15021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134778.309282:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:2.0:1787134778.315429:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134778.315752:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287883008 00000100:00100000:3.0:1787134778.315767:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287883008 00000100:00100000:3.0:1787134778.315847:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 186 00000100:00100000:3.0:1787134778.315860:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+17:11534:x1873946287883008:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787134778.315973:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.315996:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.316011:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.316332:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.316356:0:11472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907056c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.316367:0:11472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.316428:0:11472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907056c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.316445:0:11472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907056c expref: 18 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134778.316464:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942789c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311999872:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134778.316841:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa46052300 going to sleep for 11 seconds 00000100:00100000:3.0:1787134778.320811:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942789c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946311999872:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134778.320850:0:11472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134778.322137:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134778.322426:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287883136 00000100:00100000:3.0:1787134778.322437:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287883136 00010000:00010000:3.0:1787134778.322492:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907056c expref: 19 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134778.322545:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:3.0:1787134778.322565:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+19:2351:x1873946287883136:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134778.322584:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134778.322593:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907056c expref: 19 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.322617:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907056c expref: 19 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.322674:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906a11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907056c expref: 19 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.322694:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:3.0:1787134778.322701:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.322713:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.322722:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.322763:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134778.322836:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+18:2351:x1873946287883136:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 280us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134778.322845:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 70 00010000:00010000:2.0:1787134778.323070:0:11472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134778.323081:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787134778.323548:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787134778.323761:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787134778.323818:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787134778.323924:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946312000000:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787134778.323991:0:11472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134778.324030:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749540 going to sleep for 11 seconds 00000100:00100000:3.0:1787134778.324331:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312000000 00000100:00100000:3.0:1787134778.324338:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312000000 00000100:00100000:3.0:1787134778.324421:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787134778.324431:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11472:x1873946312000000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787134778.324537:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11472:x1873946312000000:12345-0@lo:1000:mdt00_003.0 Request processed in 108us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134778.324545:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787134778.324822:0:11472:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787134778.324831:0:11472:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98aa81e4f480, transno 4294967315 00000100:00100000:1.0:1787134778.324857:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946312000000:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787134778.325420:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787134778.325496:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a941b15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946312000128:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787134778.325540:0:11472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134778.325570:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787134778.325739:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312000128 00000100:00100000:0.0:1787134778.325746:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312000128 00000100:00100000:0.0:1787134778.325791:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787134778.325799:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11472:x1873946312000128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787134778.326000:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11472:x1873946312000128:12345-0@lo:1000:mdt00_003.0 Request processed in 200us (457us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787134778.326008:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787134778.326650:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a941b15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946312000128:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787134778.326695:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326783:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326792:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326800:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134778.326806:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326816:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326839:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa42a7c800) 00010000:00010000:1.0:1787134778.326843:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787134778.326850:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326856:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea800/0x69932dacae906a50 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326897:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326903:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326909:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326913:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134778.326922:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326928:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326937:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:1.0:1787134778.326940:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787134778.326942:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326948:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae90698c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326975:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.326993:0:11472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070550 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.327003:0:11472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.327041:0:11472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070550 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.327060:0:11472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070550 expref: 21 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134778.327075:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a941b17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946312000256:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134778.327256:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787134778.336751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134778.336839:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a941b17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946312000256:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134778.336879:0:11472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134778.336921:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287883264 00000100:00100000:0.0:1787134778.336931:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287883264 00010000:00010000:0.0:1787134778.336979:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070550 expref: 22 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134778.337027:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:0.0:1787134778.337059:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+22:2351:x1873946287883264:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134778.337081:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134778.337091:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070550 expref: 22 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.337105:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070550 expref: 22 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.337136:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9069a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070550 expref: 22 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.337257:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:0.0:1787134778.337264:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.337277:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.337285:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.337316:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134778.337396:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+21:2351:x1873946287883264:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 338us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134778.337405:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 71 00010000:00010000:1.0:1787134778.337622:0:11472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337630:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337646:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337653:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337660:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337666:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134778.337671:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337681:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337691:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:1.0:1787134778.337695:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134778.337907:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337916:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906a57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337939:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337945:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337952:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337958:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59debc00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134778.337961:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337969:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.337979:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99600) 00010000:00010000:1.0:1787134778.337982:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787134778.337985:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134778.338053:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59debc00/0x69932dacae906a49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134778.338648:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+20:11534:x1873946287883008:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 22788us (23233us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787134778.338658:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 186 00000020:00080000:1.0:1787134778.338662:0:11472:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787134778.339137:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134778.339144:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134778.339719:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787134778.339730:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787134778.345650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134778.345763:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287883520 00000100:00100000:0.0:1787134778.345776:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287883520 00000100:00100000:0.0:1787134778.345893:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:0.0:1787134778.345906:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa50e41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+20:11534:x1873946287883520:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787134778.347085:0:5838:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787134778.348056:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787134778.348138:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.348302:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.348320:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.348331:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.348340:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.348476:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134778.348598:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787134778.348751:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa50e41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+22:11534:x1873946287883520:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 2840us (3111us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787134778.348762:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00000020:00080000:0.0:1787134778.348769:0:5838:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787134778.349027:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134778.349038:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.349064:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134778.349070:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.349079:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.349096:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:3.0:1787134778.349100:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787134778.349105:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.349112:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906a5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134778.349134:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134778.349136:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134778.349138:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134778.816887:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134779.266118:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312000768:0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.266214:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134779.266278:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787134779.266285:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312000384:0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.266313:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134779.266335:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312000896:0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.266363:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134779.266466:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312000768 00000100:00100000:1.0:1787134779.266475:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312000768 00000100:00080000:0.0:1787134779.266569:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134779.271470:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946312000512:0@lo:400:kworker.0 00000100:00100000:0.0:1787134779.271555:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312000640:0@lo:400:kworker.0 00000100:00100000:1.0:1787134779.277994:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787134779.278017:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa55145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312000768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.278052:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312000384 00000100:00100000:2.0:1787134779.278064:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312000384 00000100:00100000:1.0:1787134779.278125:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa55145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312000768:12345-0@lo:400:kworker.0 Request processed in 116us (11909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134779.278127:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787134779.278139:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787134779.278142:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946312000384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.278203:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946312000384:12345-0@lo:400:kworker.0 Request processed in 66us (11889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134779.278215:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787134779.278253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134779.278307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134779.278345:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312001024:0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.278387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134779.278439:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312000384:0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.278458:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312000768:0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.278488:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312000896 00000100:00100000:2.0:1787134779.278493:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312000896 00000100:00100000:2.0:1787134779.278532:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312000640 00000100:00100000:2.0:1787134779.278536:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312000640 00000100:00100000:2.0:1787134779.278564:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312000512 00000100:00100000:2.0:1787134779.278568:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312000512 00000100:00100000:2.0:1787134779.278582:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787134779.278588:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312000896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.278646:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312000896:12345-0@lo:400:kworker.0 Request processed in 57us (12282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134779.278655:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787134779.278804:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787134779.278814:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312000640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.278908:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312000640:12345-0@lo:400:kworker.0 Request processed in 97us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134779.278915:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787134779.278927:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787134779.278933:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946312000512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134779.279383:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312000640:0@lo:400:kworker.0 00000100:00100000:2.0:1787134779.280201:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946312000512:12345-0@lo:400:kworker.0 Request processed in 49us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134779.280211:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787134779.282136:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312001024 00000100:00100000:1.0:1787134779.282156:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312001024 00000100:00100000:1.0:1787134779.282257:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787134779.282269:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946312001024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134779.282368:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946312001024:12345-0@lo:400:kworker.0 Request processed in 102us (3980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134779.282377:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1787134779.282434:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134779.282742:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946312000512:0@lo:400:kworker.0 00000100:00100000:1.0:1787134779.282765:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312001024:0@lo:400:kworker.0 00000100:00100000:1.0:1787134779.282809:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312000896:0@lo:400:kworker.0 00000001:00080000:1.0:1787134779.326079:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1787134779.326102:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:1.0:1787134779.779350:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787134779.779361:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787134779.779402:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787134779.779410:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787134779.782982:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787134779.783007:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312001152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134779.783091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134779.783179:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312001152 00000100:00100000:2.0:1787134779.783187:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312001152 00000100:00100000:2.0:1787134779.783237:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787134779.783246:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946312001152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787134779.783276:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787134779.783332:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946312001152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134779.783340:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787134779.783472:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312001152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787134779.840383:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134779.904715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134779.904767:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287883776 00000100:00100000:0.0:1787134779.904780:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287883776 00000100:00100000:0.0:1787134779.904860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 187 00000100:00100000:0.0:1787134779.904874:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+22:11553:x1873946287883776:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134779.904908:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134779.904938:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906a65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070588 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.905341:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906a6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.905360:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.905374:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134779.905388:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787134779.905575:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906a65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070588 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.905607:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906a6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070588 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.905618:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134779.905629:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787134779.905634:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450e00, rc 0) 00000100:00100000:0.0:1787134779.905705:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+24:11553:x1873946287883776:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 835us (999us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787134779.905711:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 187 00000100:00100000:2.0:1787134779.913462:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134779.913690:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287883904 00000100:00100000:1.0:1787134779.913703:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287883904 00000100:00100000:1.0:1787134779.913888:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 188 00000100:00100000:1.0:1787134779.913912:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+24:11553:x1873946287883904:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:1.0:1787134779.914013:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914035:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914049:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914065:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914072:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914079:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914461:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914471:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914479:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134779.914522:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914536:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914550:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914557:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914564:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134779.914569:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914577:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914605:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:1.0:1787134779.914609:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134779.914615:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914623:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906a7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914640:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914646:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914652:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914658:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134779.914668:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914675:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914683:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa50aded00) 00010000:00010000:1.0:1787134779.914686:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134779.914689:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914694:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906a81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914722:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914729:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914736:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914741:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134779.914745:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914752:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914760:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:1.0:1787134779.914762:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134779.914772:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134779.914779:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7e00/0x69932dacae906a88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134779.914878:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+24:11553:x1873946287883904:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 966us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134779.914887:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 188 00000100:00100000:1.0:1787134779.942231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134779.942274:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287884160 00000100:00100000:2.0:1787134779.942286:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287884160 00000100:00100000:2.0:1787134779.942361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 189 00000100:00100000:2.0:1787134779.942373:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+24:11556:x1873946287884160:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134779.942394:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134779.942415:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906a8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907058f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943223:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943241:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943267:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943283:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943291:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943297:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943652:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943660:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943667:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134779.943679:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787134779.943773:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943793:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943803:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943809:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134779.943819:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943827:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943840:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134779.943843:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134779.943848:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943854:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906a96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943866:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943880:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943885:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943890:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134779.943893:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943898:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943905:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa59e99300) 00010000:00010000:2.0:1787134779.943907:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134779.943916:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943922:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906a9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943974:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906a8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907058f expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943988:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907058f expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134779.943995:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:2.0:1787134779.943998:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134779.944000:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96e00, rc 0) 00000100:00100000:2.0:1787134779.944079:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+26:11556:x1873946287884160:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1710us (1858us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787134779.944088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 189 00000100:00100000:3.0:1787134779.953077:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134779.953187:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287884288 00000100:00100000:0.0:1787134779.953199:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287884288 00000100:00100000:0.0:1787134779.953252:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 190 00000100:00100000:0.0:1787134779.953263:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+26:11556:x1873946287884288:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:0.0:1787134779.953341:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.953361:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.953372:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.953400:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.953407:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.953416:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.953422:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134779.953428:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.953451:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.953465:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:0.0:1787134779.953468:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787134779.953473:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134779.953480:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906ab2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134779.953561:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+26:11556:x1873946287884288:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 299us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134779.953568:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 190 00000100:00100000:3.0:1787134779.980150:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134779.980216:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287884544 00000100:00100000:3.0:1787134779.980228:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287884544 00000100:00100000:3.0:1787134779.980285:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:3.0:1787134779.980296:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+26:11556:x1873946287884544:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787134779.980523:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+27:11556:x1873946287884544:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 228us (387us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787134779.980532:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:3.0:1787134780.029512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.029573:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287884800 00000100:00100000:1.0:1787134780.029584:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287884800 00000100:00080000:0.0:1787134780.029718:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134780.029757:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 191 00000100:00100000:1.0:1787134780.029770:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+27:11082:x1873946287884800:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134780.029806:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134780.029831:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906ab9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070596 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.029945:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.029962:0:11472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907058f expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.029971:0:11472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.030023:0:11472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907058f expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.030060:0:11472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907058f expref: 28 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134780.030080:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a941b17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946312001280:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134780.030231:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749300 going to sleep for 11 seconds 00000100:00100000:1.0:1787134780.036302:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134780.036444:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287884928 00000100:00100000:3.0:1787134780.036455:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287884928 00010000:00010000:3.0:1787134780.036632:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907058f expref: 29 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134780.036677:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:3.0:1787134780.036687:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+29:2351:x1873946287884928:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134780.036702:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134780.036711:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907058f expref: 29 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.036724:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907058f expref: 29 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.036750:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:3.0:1787134780.036755:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.036765:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.036773:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.036801:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134780.036840:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906aa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907058f expref: 29 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134780.036862:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a941b17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946312001280:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134780.036884:0:11472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.036893:0:11472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.036899:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134780.036931:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787134780.037074:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae906ab9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070596 expref: 30 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.037093:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070596 expref: 29 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.037100:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:2.0:1787134780.037103:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787134780.037105:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7600, rc 0) 00000100:00100000:3.0:1787134780.037140:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+29:2351:x1873946287884928:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 453us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134780.037148:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+29:11082:x1873946287884800:12345-192.168.202.36@tcp:101:bash.0 Request processed in 7380us (7642us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787134780.037154:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:2.0:1787134780.037185:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 191 00000100:00100000:2.0:1787134780.042720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.042994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287885184 00000100:00100000:1.0:1787134780.043009:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287885184 00000100:00100000:1.0:1787134780.043085:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 192 00000100:00100000:1.0:1787134780.043097:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+28:11082:x1873946287885184:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:1.0:1787134780.043617:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.043641:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.043655:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787134780.043713:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1787134780.043737:0:5837:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000bd676b97 reply state 0000000021805b1a transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134780.043746:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787134780.044030:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1787134780.044337:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+32:11082:x1873946287885184:12345-192.168.202.36@tcp:36:bash.0 Request processed in 1239us (1626us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787134780.044345:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 192 00000020:00080000:1.0:1787134780.044362:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787134780.053851:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134780.054020:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287885312 00000100:00100000:2.0:1787134780.054037:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287885312 00000100:00100000:2.0:1787134780.054102:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 193 00000100:00100000:2.0:1787134780.054112:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+32:11082:x1873946287885312:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134780.054152:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134780.054213:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906ad5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907059d expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.054284:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906ad5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907059d expref: 33 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.054299:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906ad5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907059d expref: 33 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.054329:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:2.0:1787134780.054332:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134780.054336:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96e00, rc 0) 00000100:00100000:2.0:1787134780.054395:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+33:11082:x1873946287885312:12345-192.168.202.36@tcp:101:bash.0 Request processed in 284us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134780.054403:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 193 00010000:00010000:0.0:1787134780.054620:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.054633:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.054640:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.054646:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134780.054651:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.054659:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.054683:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:0.0:1787134780.054685:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134780.054690:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.054697:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7c00/0x69932dacae906ace lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134780.060408:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134780.060877:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287885440 00000100:00100000:0.0:1787134780.060890:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287885440 00000100:00100000:0.0:1787134780.060983:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:0.0:1787134780.060994:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:11082:x1873946287885440:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787134780.061012:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134780.061035:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705a4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787134780.061064:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a858339, atime: 0x6a858337, ctime: 0x6a858339, blocks: 0xb 00010000:00010000:0.0:1787134780.061090:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1787134780.061095:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134780.061103:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705a4 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.061133:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705a4 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.061148:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450000, rc 0) 00000100:00100000:0.0:1787134780.061240:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+8:11082:x1873946287885440:12345-192.168.202.36@tcp:101:bash.0 Request processed in 248us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134780.061261:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00080000:1.0:1787134780.061351:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134780.064401:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134780.064641:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287885568 00000100:00100000:3.0:1787134780.064657:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287885568 00002000:00010000:3.0:1787134780.064713:0:6686:0:(ofd_dev.c:2828:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1787134780.064720:0:6686:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98a941b17480 with x1873946287885568 ext(0->18446744073709551615) 00002000:00010000:3.0:1787134780.064734:0:6686:0:(ofd_dev.c:2833:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a941b17480. 00000100:00100000:3.0:1787134780.064773:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787134780.064786:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486fb1ad-4266-4864-b299-111c5140734b+8:2352:x1873946287885568:12345-192.168.202.36@tcp:10:bash.0 00002000:00010000:3.0:1787134780.065125:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787134780.065130:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787134777 -> 1787134780 00002000:00010000:3.0:1787134780.065132:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787134775 -> 1787134775 00002000:00010000:3.0:1787134780.065135:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787134777 -> 1787134780 00002000:00010000:3.0:1787134780.065137:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787134780.065945:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287885568:12345-192.168.202.36@tcp:10:bash.0 Request processed in 1158us (1554us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787134780.065958:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00002000:00010000:3.0:1787134780.065963:0:6686:0:(ofd_dev.c:2828:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1787134780.065966:0:6686:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98a941b17480 with x1873946287885568 ext(0->18446744073709551615) 00002000:00010000:3.0:1787134780.065973:0:6686:0:(ofd_dev.c:2833:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a941b17480. 00000100:00100000:3.0:1787134780.149479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134780.149524:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134780.149566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.149669:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287885696 00000100:00100000:1.0:1787134780.149682:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287885696 00000100:00100000:1.0:1787134780.149744:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 304 00000100:00100000:2.0:1787134780.149745:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287885952 00000100:00100000:2.0:1787134780.149753:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287885952 00000100:00100000:1.0:1787134780.149758:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287885696:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134780.149824:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 179 00000100:00100000:2.0:1787134780.149835:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287885952:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134780.149839:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287885696:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 84us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134780.149848:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 304 00000100:00100000:2.0:1787134780.149879:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287885952:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 45us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134780.149888:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 179 00000100:00080000:2.0:1787134780.149909:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134780.150287:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287885824 00000100:00100000:0.0:1787134780.150292:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287885824 00000100:00100000:0.0:1787134780.150341:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00100000:0.0:1787134780.150350:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287885824:12345-192.168.202.36@tcp:400:kworker.0 00000100:00080000:2.0:1787134780.150374:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134780.150394:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287885824:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 44us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134780.150402:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00100000:3.0:1787134780.168437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.168526:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287886080 00000100:00100000:1.0:1787134780.168536:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287886080 00000100:00100000:1.0:1787134780.168622:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 194 00000100:00100000:1.0:1787134780.168634:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+32:11570:x1873946287886080:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:1.0:1787134780.168720:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.168738:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.168750:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.168765:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.168772:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.168799:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169094:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169103:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169110:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134780.169147:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169195:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169203:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169209:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169215:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134780.169219:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169226:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169240:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:1.0:1787134780.169249:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134780.169255:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169261:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906ae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169274:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169279:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169285:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169289:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134780.169293:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169298:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169305:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa50ade400) 00010000:00010000:1.0:1787134780.169307:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134780.169310:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169315:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906aea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169329:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169340:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169345:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169350:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134780.169353:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169358:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169364:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:1.0:1787134780.169366:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134780.169369:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.169373:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134780.169439:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+32:11570:x1873946287886080:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 806us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134780.169448:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 194 00000100:00100000:3.0:1787134780.231637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134780.231737:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287886336 00000100:00100000:2.0:1787134780.231749:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287886336 00000100:00100000:2.0:1787134780.231811:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 195 00000100:00100000:2.0:1787134780.231821:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+32:11573:x1873946287886336:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134780.231843:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134780.231863:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906af8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705ab expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.231944:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.231978:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.231990:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232005:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232013:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232019:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232390:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232401:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232407:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134780.232419:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787134780.232514:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232522:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232528:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232542:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134780.232547:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232555:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232569:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134780.232573:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134780.232577:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232582:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906aff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232606:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232613:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232618:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232623:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134780.232626:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232632:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232650:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa59e99300) 00010000:00010000:2.0:1787134780.232653:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134780.232656:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232662:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232711:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906af8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ab expref: 35 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232727:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ab expref: 34 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.232735:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:2.0:1787134780.232738:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787134780.232740:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97000, rc 0) 00000100:00100000:2.0:1787134780.232810:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+34:11573:x1873946287886336:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 990us (1183us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787134780.232818:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 195 00000100:00100000:0.0:1787134780.241719:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134780.241825:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287886464 00000100:00100000:2.0:1787134780.241836:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287886464 00000100:00100000:2.0:1787134780.241903:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 196 00000100:00100000:2.0:1787134780.241914:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+34:11573:x1873946287886464:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787134780.241988:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.242006:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070596 expref: 34 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.242029:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.242062:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070596 expref: 34 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.242076:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070596 expref: 34 pid: 11472 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134780.242091:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94215aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946312001408:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134780.242208:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa524ea480 going to sleep for 11 seconds 00000100:00100000:0.0:1787134780.258103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134780.258376:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94215aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946312001408:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134780.258401:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134780.258449:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287886720 00000100:00100000:1.0:1787134780.258457:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287886720 00000100:00100000:1.0:1787134780.258514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:1.0:1787134780.258524:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+35:5591:x1873946287886720:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787134780.258872:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+36:5591:x1873946287886720:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 349us (778us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787134780.258893:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:1.0:1787134780.265994:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134780.266533:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287886848 00000100:00100000:0.0:1787134780.266659:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287886848 00010000:00010000:0.0:1787134780.266711:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070596 expref: 36 pid: 11472 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134780.266757:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 73 00000100:00100000:0.0:1787134780.266768:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+36:2352:x1873946287886848:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134780.266785:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134780.266793:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070596 expref: 36 pid: 11472 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.266808:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070596 expref: 36 pid: 11472 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.266832:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906ac0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070596 expref: 36 pid: 11472 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.266869:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:0.0:1787134780.266875:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.266885:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.266894:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.266930:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134780.266995:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+35:2352:x1873946287886848:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 228us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134780.267132:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 73 00010000:00010000:2.0:1787134780.267350:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.267358:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.267385:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.267390:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.267394:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.267404:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134780.267407:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.267412:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.267420:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:2.0:1787134780.267422:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134780.267424:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.267429:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134780.267464:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+34:11573:x1873946287886464:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 25554us (25756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134780.267472:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 196 00000100:00100000:0.0:1787134780.273600:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134780.273650:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287887104 00000100:00100000:2.0:1787134780.273661:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287887104 00000100:00100000:2.0:1787134780.273724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:2.0:1787134780.273734:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+34:11573:x1873946287887104:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787134780.273983:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+35:11573:x1873946287887104:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 250us (409us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787134780.273991:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:0.0:1787134780.418845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.418928:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287887360 00000100:00100000:1.0:1787134780.418939:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287887360 00000100:00100000:1.0:1787134780.419017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 197 00000100:00100000:1.0:1787134780.419028:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+35:11584:x1873946287887360:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:1.0:1787134780.419053:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134780.419073:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906b22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705b2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419155:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419195:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419209:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419225:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419232:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419239:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419749:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906b37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419766:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419773:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134780.419786:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787134780.419875:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419882:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419890:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419896:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134780.419900:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419908:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419920:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:1.0:1787134780.419922:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134780.419927:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419933:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419945:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419956:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419962:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419966:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134780.419969:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419975:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419981:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa50ade400) 00010000:00010000:1.0:1787134780.419983:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134780.419986:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.419991:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.420778:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906b22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b2 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.420794:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906b37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b2 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.420802:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:1.0:1787134780.420804:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134780.420815:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6000, rc 0) 00000100:00100000:1.0:1787134780.420887:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+37:11584:x1873946287887360:12345-192.168.202.36@tcp:101:cat.0 Request processed in 1860us (2052us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787134780.420896:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 197 00000100:00100000:1.0:1787134780.441253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134780.441456:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287887616 00000100:00100000:3.0:1787134780.441469:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287887616 00000100:00100000:3.0:1787134780.441538:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:3.0:1787134780.441562:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+37:11584:x1873946287887616:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:3.0:1787134780.441831:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+38:11584:x1873946287887616:12345-192.168.202.36@tcp:35:cat.0 Request processed in 270us (592us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787134780.441839:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:0.0:1787134780.540755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134780.540993:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287887872 00000100:00100000:2.0:1787134780.541004:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287887872 00000100:00100000:2.0:1787134780.541066:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 198 00000100:00100000:2.0:1787134780.541091:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+38:11585:x1873946287887872:12345-192.168.202.36@tcp:36:rm.0 00010000:00010000:2.0:1787134780.541205:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787134780.541438:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906b37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b2 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.541464:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ab expref: 37 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.541664:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906ad5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907059d expref: 36 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.541678:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99200) 00010000:00010000:2.0:1787134780.541689:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134780.541711:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.541796:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.541809:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.541824:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.541832:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.541908:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.542338:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.542347:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.542354:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787134780.543883:0:11683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787134780.543899:0:11683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396510739751ns, next at 397510736491ns, rc = 0 00010000:00010000:2.0:1787134780.543981:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.543996:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544006:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544015:0:11683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544022:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544028:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544046:0:11683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134780.544068:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544084:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544090:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544096:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134780.544102:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544110:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544123:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99b00) 00010000:00010000:2.0:1787134780.544126:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787134780.544131:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544137:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544211:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544218:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544683:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544690:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134780.544704:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.544711:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.544872:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134780.544880:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.544887:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134780.544890:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.544897:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.544909:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98aa59e99b00) 00010000:00010000:0.0:1787134780.544919:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787134780.544923:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.544929:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906b5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134780.544950:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134780.544952:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134780.544954:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134780.545055:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134780.545059:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134780.545062:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.545069:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787134780.545082:0:11683:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000001891c2ab reply state 000000003f69dcd7 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134780.545092:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134780.547003:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+37:11585:x1873946287887872:12345-192.168.202.36@tcp:36:rm.0 Request processed in 4745us (5091us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787134780.547016:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 198 00010000:00010000:3.0:1787134780.557816:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.557842:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.557851:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.557857:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134780.557862:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.557870:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.557886:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa59e99300) 00010000:00010000:3.0:1787134780.557889:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134780.557894:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.557900:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906b4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134780.637029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134780.637415:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287888128 00000100:00100000:2.0:1787134780.637428:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287888128 00000100:00100000:2.0:1787134780.637497:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 199 00000100:00100000:2.0:1787134780.637509:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+36:11591:x1873946287888128:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134780.637543:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134780.637565:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705b9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.637714:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.637870:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.637884:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.637903:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.637910:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.637918:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787134780.640868:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787134780.641065:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.641081:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.641093:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.641125:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.641131:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.641139:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.641155:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134780.641193:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.641202:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.641215:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134780.641218:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134780.641230:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.641237:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906b68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787134780.641251:0:5835:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000000805d377 reply state 0000000097d6a059 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134780.641988:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787134780.642030:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906b61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b9 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.642048:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b9 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.642056:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134780.642059:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134780.642062:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97000, rc 0) 00000100:00100000:2.0:1787134780.642139:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+39:11591:x1873946287888128:12345-192.168.202.36@tcp:101:bash.0 Request processed in 4632us (5121us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787134780.642155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 199 00010000:00010000:1.0:1787134780.647771:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.647791:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.647800:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.647807:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134780.647813:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.647822:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.647851:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa59e99200) 00010000:00010000:1.0:1787134780.647855:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134780.647861:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.647867:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906b6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134780.648320:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134780.648488:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287888256 00000100:00100000:2.0:1787134780.648500:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287888256 00000100:00100000:2.0:1787134780.648563:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:2.0:1787134780.648575:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+5:2352:x1873946287888256:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134780.648605:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134780.648625:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705c0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787134780.648653:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134780.648673:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787134780.648678:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134780.648687:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c0 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.648706:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c0 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.648718:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97e00, rc 0) 00000100:00100000:2.0:1787134780.648790:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287888256:12345-192.168.202.36@tcp:101:bash.0 Request processed in 218us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134780.648797:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:0.0:1787134780.653961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134780.654061:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287888384 00000100:00100000:2.0:1787134780.654073:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287888384 00000100:00100000:2.0:1787134780.654222:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:2.0:1787134780.654232:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+6:11591:x1873946287888384:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134780.654281:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134780.654299:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705c7 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.654335:0:11954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c0 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.654346:0:11954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134780.654351:0:11954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134780.654356:0:11954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 7 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.654394:0:11954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c0 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.654408:0:11954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c0 expref: 7 pid: 6681 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134780.654423:0:11954:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94215aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11954:1873946312001536:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134780.654528:0:11954:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa524ea780 going to sleep for 11 seconds 00000100:00100000:1.0:1787134780.658792:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134780.658977:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287888512 00000100:00100000:3.0:1787134780.658987:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287888512 00010000:00010000:3.0:1787134780.659042:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c0 expref: 8 pid: 6681 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134780.659086:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:3.0:1787134780.659098:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287888512:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134780.659114:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134780.659139:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c0 expref: 8 pid: 6681 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.659154:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c0 expref: 8 pid: 6681 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.659205:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134780.659210:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134780.659219:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 8 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.659231:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 8 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.659394:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 8 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134780.659411:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942789f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1873946312001664:192.168.202.36@tcp:105: 00000100:00100000:3.0:1787134780.659499:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd98900 going to sleep for 11 seconds 00010000:00010000:2.0:1787134780.659744:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7da9f72/0x69932dacae906b84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c0 expref: 8 pid: 6681 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134780.659763:0:11954:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94215aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11954:1873946312001536:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134780.659789:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 7 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.659809:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96c00, rc 0) 00000100:00100000:2.0:1787134780.660234:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+7:11591:x1873946287888384:12345-192.168.202.36@tcp:101:bash.0 Request processed in 6001us (6282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134780.660243:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:1.0:1787134780.666399:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134780.666518:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942789f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1873946312001664:192.168.202.36@tcp:105: 00010000:00010000:3.0:1787134780.666551:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134780.666613:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+6:2351:x1873946287888512:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 7517us (7831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134780.666625:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:0.0:1787134780.668186:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287888768 00000100:00100000:0.0:1787134780.668200:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287888768 00000100:00100000:0.0:1787134780.668258:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:0.0:1787134780.668280:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+38:11591:x1873946287888768:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:0.0:1787134780.669106:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+39:11591:x1873946287888768:12345-192.168.202.36@tcp:35:bash.0 Request processed in 823us (2714us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787134780.669116:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 55 00010000:00010000:3.0:1787134780.866944:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134780.880495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.886893:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287888896 00000100:00100000:1.0:1787134780.886912:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287888896 00000100:00100000:1.0:1787134780.886990:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 200 00000100:00100000:1.0:1787134780.887000:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+39:11607:x1873946287888896:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134780.887024:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134780.887044:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705ce expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.887106:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.887120:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.887132:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134780.887204:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787134780.887208:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134780.887227:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.887250:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906b92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ce expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.887269:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ce expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.887278:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:1.0:1787134780.887281:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134780.887300:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6800, rc 0) 00000100:00100000:1.0:1787134780.887377:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+40:11607:x1873946287888896:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 378us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134780.887384:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 200 00000100:00100000:2.0:1787134780.902417:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.904952:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287889152 00000100:00100000:1.0:1787134780.904968:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287889152 00000100:00100000:2.0:1787134780.905458:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 201 00000100:00100000:2.0:1787134780.905600:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+40:11607:x1873946287889152:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134780.905625:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134780.905648:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906ba0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705d5 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.905926:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.905941:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.905954:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134780.905967:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787134780.906096:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906ba0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705d5 expref: 43 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.906118:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705d5 expref: 42 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.906145:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134780.906148:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134780.906152:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97400, rc 0) 00000100:00100000:2.0:1787134780.906326:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+42:11607:x1873946287889152:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 856us (3919us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787134780.906334:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 201 00000100:00100000:0.0:1787134780.914547:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134780.914628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.914945:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287889280 00000100:00100000:1.0:1787134780.914972:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287889280 00000100:00100000:1.0:1787134780.915051:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:1.0:1787134780.915061:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+42:2350:x1873946287889280:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134780.915085:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134780.915117:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705d5 expref: 42 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.915142:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134780.915153:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134780.915566:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+41:2350:x1873946287889280:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 505us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134780.915595:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:2.0:1787134780.915892:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287889536 00000100:00100000:2.0:1787134780.915899:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287889536 00000100:00100000:2.0:1787134780.915952:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 202 00000100:00100000:2.0:1787134780.915967:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+41:11607:x1873946287889536:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134780.915996:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134780.916021:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906bb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.916153:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.916214:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.916242:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134780.916282:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787134780.916461:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906bb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705dc expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.916547:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705dc expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.916555:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134780.916558:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787134780.916560:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96a00, rc 0) 00000100:00100000:2.0:1787134780.916610:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+43:11607:x1873946287889536:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 651us (1983us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787134780.916617:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 202 00000100:00100000:0.0:1787134780.933819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.934382:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287889664 00000100:00100000:1.0:1787134780.934395:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287889664 00000100:00100000:1.0:1787134780.934456:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:1.0:1787134780.934466:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+6:2352:x1873946287889664:12345-192.168.202.36@tcp:1:lfs.0 00010000:00010000:1.0:1787134780.934508:0:7839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.934541:0:7839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 6 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.934566:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134780.934570:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134780.934575:0:7839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.934875:0:7839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 6 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.934892:0:7839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 6 pid: 11954 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134780.934907:0:7839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a941b16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7839:1873946312001792:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134780.935006:0:7839:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f7490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134780.946546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.947011:0:7839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a941b16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7839:1873946312001792:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134780.947043:0:7839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134780.951392:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287889792 00000100:00100000:3.0:1787134780.951409:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287889792 00002000:00100000:3.0:1787134780.951548:0:6687:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98aa81034a80 x1873946287889792/t0(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:716/0 lens 504/0 e 0 to 0 dl 1787134791 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787134780.951560:0:6687:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa81034a80 with x1873946287889792 ext(0->8) 00010000:00010000:3.0:1787134780.951570:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 7 pid: 11954 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.951597:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 7 pid: 11954 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787134780.951605:0:6687:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98aa81034a80 00000100:00100000:3.0:1787134780.951690:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:3.0:1787134780.951702:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287889792:12345-192.168.202.36@tcp:4:lfs.0 00000100:00100000:3.0:1787134780.952536:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486fb1ad-4266-4864-b299-111c5140734b+9:2351:x1873946287889792:12345-192.168.202.36@tcp:4:lfs.0 Request processed in 833us (6070us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787134780.952546:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00002000:00100000:3.0:1787134780.952554:0:6687:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98aa81034a80 x1873946287889792/t4294967308(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:716/0 lens 504/448 e 0 to 0 dl 1787134791 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787134780.952574:0:6687:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa81034a80 with x1873946287889792 ext(0->8) 00010000:00010000:3.0:1787134780.952591:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 9 pid: 11954 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.952606:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 9 pid: 11954 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787134780.952614:0:6687:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98aa81034a80 00000100:00100000:0.0:1787134780.964965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.965123:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287889920 00000100:00100000:1.0:1787134780.965133:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287889920 00010000:00010000:1.0:1787134780.965209:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 9 pid: 11954 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134780.965253:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:1.0:1787134780.965262:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81037100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+9:2350:x1873946287889920:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134780.965293:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787134780.965317:0:7620:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787134780.965320:0:7620:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787134781 00002000:00010000:1.0:1787134780.965323:0:7620:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787134781 00002000:00010000:1.0:1787134780.965325:0:7620:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787134781 00010000:00010000:1.0:1787134780.965332:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 9 pid: 11954 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.965346:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 9 pid: 11954 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.965369:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdc523b1/0x69932dacae906b8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705c7 expref: 9 pid: 11954 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.965386:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134780.965391:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134780.965398:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.965408:0:7620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.965447:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134780.965498:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81037100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+8:2350:x1873946287889920:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 237us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134780.965506:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 75 00010000:00010000:2.0:1787134780.965861:0:7839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.965872:0:7839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.965898:0:7839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.965908:0:7839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.965916:0:7839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.965924:0:7839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134780.965935:0:7839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.965945:0:7839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.965957:0:7839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.965965:0:7839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000257612df/0x69932dacae906bca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134780.966016:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+7:2352:x1873946287889664:12345-192.168.202.36@tcp:1:lfs.0 Request processed in 31552us (32207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134780.966025:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:0.0:1787134780.973616:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134780.973924:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287890176 00000100:00100000:3.0:1787134780.973935:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287890176 00000100:00100000:3.0:1787134780.974038:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:3.0:1787134780.974048:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa515ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+43:11607:x1873946287890176:12345-192.168.202.36@tcp:35:lfs.0 00000004:00010000:3.0:1787134780.974114:0:12060:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705dc expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787134780.974507:0:12060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787134780.974550:0:12060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787134780.975192:0:12060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787134780.975245:0:12060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.975449:0:12060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b9 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.975459:0:12060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.975522:0:12060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b9 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.975539:0:12060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b9 expref: 47 pid: 5835 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134780.975558:0:12060:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942788a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12060:1873946312001920:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134780.975746:0:12060:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd98900 going to sleep for 11 seconds 00000100:00100000:0.0:1787134780.980471:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.980548:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287890304 00000100:00100000:1.0:1787134780.980560:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287890304 00010000:00010000:1.0:1787134780.980618:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b9 expref: 48 pid: 5835 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134780.980667:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:1.0:1787134780.980679:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+48:2352:x1873946287890304:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134780.980698:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134780.980707:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b9 expref: 48 pid: 5835 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.980731:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b9 expref: 48 pid: 5835 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.980761:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:1.0:1787134780.980769:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.980782:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.980791:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134780.980817:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134780.981043:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+48:2352:x1873946287890304:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 363us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134780.981052:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 76 00010000:00010000:3.0:1787134780.983094:0:12060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906b76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705b9 expref: 47 pid: 5835 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134780.983119:0:12060:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942788a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12060:1873946312001920:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134780.983151:0:12060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.983434:0:12060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.983442:0:12060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787134780.983577:0:12060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787134780.983792:0:12060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787134780.983913:0:12060:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942788a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12060:1873946312002048:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787134780.983998:0:12060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134780.984034:0:12060:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd98cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134780.984190:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312002048 00000100:00100000:0.0:1787134780.984198:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312002048 00000100:00100000:0.0:1787134780.984249:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787134780.984269:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12060:x1873946312002048:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787134780.984362:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12060:x1873946312002048:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 106us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134780.984370:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787134780.984455:0:12060:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787134780.984462:0:12060:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1787134780.984480:0:12060:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98aa81e4f800, transno 4294967307 00000100:00100000:2.0:1787134780.984503:0:12060:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942788a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12060:1873946312002048:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787134780.985050:0:12060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787134780.985109:0:12060:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94215b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12060:1873946312002176:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787134780.985144:0:12060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134780.985193:0:12060:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa44fbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134780.985572:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312002176 00000100:00100000:0.0:1787134780.985578:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312002176 00000100:00100000:0.0:1787134780.985617:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787134780.985624:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12060:x1873946312002176:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787134780.985763:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12060:x1873946312002176:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 138us (618us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787134780.985770:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787134780.986321:0:12060:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94215b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12060:1873946312002176:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787134780.986372:0:12060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787134780.986413:0:12060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.986433:0:12060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.986440:0:12060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.986446:0:12060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134780.986451:0:12060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.986459:0:12060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.986489:0:12060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134780.986492:0:12060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787134780.986495:0:12060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134780.986502:0:12060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deb800/0x69932dacae906bd1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787134780.986678:0:12060:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787134780.986763:0:12060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787134780.986774:0:12060:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396953615055ns, next at 397953612870ns, rc = 0 00000001:00080000:2.0:1787134780.986780:0:12060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787134780.986809:0:12060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134780.986812:0:12060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787134780.986820:0:12060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705dc expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134780.987542:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa515ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+50:11607:x1873946287890176:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 13494us (13936us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787134780.987551:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00000020:00080000:2.0:1787134780.987556:0:12060:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787134780.990274:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134780.990417:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287890432 00000100:00100000:3.0:1787134780.990440:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287890432 00000100:00100000:3.0:1787134780.990506:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 203 00000100:00100000:3.0:1787134780.990515:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+50:11607:x1873946287890432:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787134780.990548:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134780.990570:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906bd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.990639:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705e3 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.990654:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705e3 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134780.990673:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:3.0:1787134780.990676:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787134780.990680:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deac00, rc 0) 00000100:00100000:3.0:1787134780.990726:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+51:11607:x1873946287890432:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 213us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134780.990734:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 203 00000100:00100000:0.0:1787134780.996274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134780.996488:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287890688 00000100:00100000:1.0:1787134780.996507:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287890688 00000100:00100000:1.0:1787134780.996566:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:1.0:1787134780.996576:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+51:11607:x1873946287890688:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787134780.996825:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+52:11607:x1873946287890688:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 250us (573us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787134780.996930:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:0.0:1787134781.122645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134781.122774:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287890816 00000100:00100000:2.0:1787134781.122784:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287890816 00000100:00100000:2.0:1787134781.122846:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 204 00000100:00100000:2.0:1787134781.122858:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+52:11617:x1873946287890816:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:2.0:1787134781.122941:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.122958:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.122972:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.122988:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.122995:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123002:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123100:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123127:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123135:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787134781.123203:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123217:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123224:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123232:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123238:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134781.123243:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123689:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123706:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134781.123708:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134781.123768:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123776:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96a00/0x69932dacae906bdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123798:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123804:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123809:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123813:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134781.123816:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123822:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123830:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa59e99900) 00010000:00010000:2.0:1787134781.123833:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134781.123836:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123841:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906be6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123856:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123862:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123867:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123878:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134781.123881:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123887:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123895:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134781.123897:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134781.123901:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.123906:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906bed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134781.124028:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+52:11617:x1873946287890816:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1170us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134781.124037:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 204 00000100:00100000:0.0:1787134781.180271:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134781.180361:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287891072 00000100:00100000:1.0:1787134781.180371:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287891072 00000100:00100000:1.0:1787134781.180434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 205 00000100:00100000:1.0:1787134781.180445:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+52:11620:x1873946287891072:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134781.180467:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134781.180490:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906bf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705ea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180564:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180597:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180610:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180626:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180633:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180641:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180792:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180801:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180809:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134781.180820:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787134781.180920:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180929:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180936:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180942:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134781.180947:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180956:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180970:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:1.0:1787134781.180973:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134781.180977:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.180994:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906bfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181009:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181016:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181023:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181028:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134781.181032:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181038:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181046:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa50ade400) 00010000:00010000:1.0:1787134781.181049:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134781.181052:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181058:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6400/0x69932dacae906c02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181098:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906bf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ea expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181112:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ea expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.181125:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:1.0:1787134781.181128:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134781.181130:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6a00, rc 0) 00000100:00100000:1.0:1787134781.181244:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+54:11620:x1873946287891072:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 801us (983us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787134781.181251:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 205 00000100:00100000:2.0:1787134781.188035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134781.188406:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287891200 00000100:00100000:1.0:1787134781.188416:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287891200 00000100:00100000:1.0:1787134781.188476:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 206 00000100:00100000:1.0:1787134781.188488:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+54:11620:x1873946287891200:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:1.0:1787134781.188565:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.188599:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.188611:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.188637:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.188645:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.188651:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.188657:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134781.188678:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.188686:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.188699:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:1.0:1787134781.188702:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134781.188707:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.188839:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7000/0x69932dacae906c17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134781.188921:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+54:11620:x1873946287891200:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 435us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134781.188929:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 206 00000100:00100000:2.0:1787134781.197594:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134781.207232:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287891456 00000100:00100000:3.0:1787134781.207251:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287891456 00000100:00100000:3.0:1787134781.207327:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:3.0:1787134781.207338:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+54:11620:x1873946287891456:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787134781.208501:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+55:11620:x1873946287891456:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 1156us (10920us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787134781.208514:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:2.0:1787134781.277257:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134781.277358:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287891712 00000100:00100000:0.0:1787134781.277369:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287891712 00000100:00100000:0.0:1787134781.277428:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 207 00000100:00100000:0.0:1787134781.277439:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+55:11630:x1873946287891712:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787134781.277463:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134781.277466:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787134781.277491:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae906b99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ce expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.277511:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134781.277516:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787134781.277542:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906c1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705f1 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.277656:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.277670:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ea expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.277679:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.277713:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ea expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.277738:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ea expref: 55 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134781.277751:0:11683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1873946312002304:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134781.277839:0:11683:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa583a5480 going to sleep for 11 seconds 00000100:00100000:0.0:1787134781.282016:0:11683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1873946312002304:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134781.282049:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134781.284234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134781.286801:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287891840 00000100:00100000:1.0:1787134781.286816:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287891840 00010000:00010000:1.0:1787134781.286867:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ea expref: 56 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134781.286907:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:1.0:1787134781.286918:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+56:2352:x1873946287891840:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134781.286934:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134781.286940:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ea expref: 56 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.286954:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ea expref: 56 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.286993:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6a00/0x69932dacae906c09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ea expref: 56 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.287008:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:1.0:1787134781.287013:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.287022:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.287945:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.288036:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134781.288114:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+55:2352:x1873946287891840:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 1194us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134781.288124:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 77 00010000:00010000:2.0:1787134781.292011:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.292042:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134781.292070:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787134781.292278:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450400/0x69932dacae906c1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f1 expref: 56 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.292300:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f1 expref: 55 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.292308:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134781.292311:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787134781.292315:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451000, rc 0) 00000100:00100000:2.0:1787134781.292386:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+55:11630:x1873946287891712:12345-192.168.202.36@tcp:101:bash.0 Request processed in 14949us (15139us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787134781.292394:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 207 00000100:00100000:2.0:1787134781.296362:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134781.296563:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287892096 00000100:00100000:3.0:1787134781.296596:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287892096 00000100:00100000:3.0:1787134781.296660:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 208 00000100:00100000:3.0:1787134781.296670:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+55:11630:x1873946287892096:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:3.0:1787134781.296915:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.296931:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.296941:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787134781.296981:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787134781.296999:0:5836:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000525e5828 reply state 0000000041caabcd transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134781.297007:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787134781.297098:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+58:11630:x1873946287892096:12345-192.168.202.36@tcp:36:bash.0 Request processed in 430us (745us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787134781.297105:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 208 00000020:00080000:3.0:1787134781.297109:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787134781.300257:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.300280:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.300288:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.300294:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134781.300300:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.300328:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.300349:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:3.0:1787134781.300352:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134781.300358:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.300365:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134781.302296:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134781.302366:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287892224 00000100:00100000:0.0:1787134781.302376:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287892224 00000100:00100000:0.0:1787134781.302431:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 209 00000100:00100000:0.0:1787134781.302440:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+57:11630:x1873946287892224:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787134781.302466:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134781.302506:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906c3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705f8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.302621:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.302639:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f1 expref: 58 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.302656:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.302691:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f1 expref: 58 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.302705:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f1 expref: 58 pid: 11683 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134781.302720:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81021180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946312002432:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134781.302808:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa583a5480 going to sleep for 11 seconds 00000100:00100000:0.0:1787134781.305973:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81021180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946312002432:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134781.306008:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134781.308504:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134781.308891:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287892352 00000100:00100000:0.0:1787134781.308900:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287892352 00010000:00010000:0.0:1787134781.308943:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f1 expref: 59 pid: 11683 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134781.309006:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:0.0:1787134781.309015:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+59:2351:x1873946287892352:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134781.309099:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134781.309107:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f1 expref: 59 pid: 11683 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.309119:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f1 expref: 59 pid: 11683 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.309142:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906c25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f1 expref: 59 pid: 11683 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.309286:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:0.0:1787134781.309293:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.309304:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.309312:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134781.309336:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134781.309395:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+58:2351:x1873946287892352:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 381us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134781.309402:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 78 00010000:00010000:2.0:1787134781.311137:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.311154:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134781.311236:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787134781.311241:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134781.311261:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.311301:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450c00/0x69932dacae906c3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f8 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.311322:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f8 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.311347:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134781.311350:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134781.311353:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451a00, rc 0) 00000100:00100000:2.0:1787134781.311407:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+57:11630:x1873946287892224:12345-192.168.202.36@tcp:101:bash.0 Request processed in 8967us (9120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134781.311415:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 209 00000100:00100000:2.0:1787134781.315493:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134781.315568:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287892608 00000100:00100000:1.0:1787134781.315589:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287892608 00000100:00100000:1.0:1787134781.315688:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:1.0:1787134781.315698:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+57:11630:x1873946287892608:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:1.0:1787134781.316462:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+58:11630:x1873946287892608:12345-192.168.202.36@tcp:35:bash.0 Request processed in 762us (976us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787134781.316472:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:1.0:1787134781.431325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134781.431421:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287892736 00000100:00100000:2.0:1787134781.431432:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287892736 00000100:00100000:2.0:1787134781.431494:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 210 00000100:00100000:2.0:1787134781.431504:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+58:11636:x1873946287892736:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134781.431528:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134781.431549:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90705ff expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.431639:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906c4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.431666:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.431678:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134781.431744:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787134781.431747:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134781.431771:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.431814:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ff expref: 60 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.431835:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ff expref: 59 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.431844:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134781.431847:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787134781.431851:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97e00, rc 0) 00000100:00100000:2.0:1787134781.432115:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+59:11636:x1873946287892736:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 419us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134781.432125:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 210 00000100:00100000:3.0:1787134781.434665:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134781.434920:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287892864 00000100:00100000:1.0:1787134781.434931:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287892864 00000100:00100000:1.0:1787134781.434999:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 211 00000100:00100000:1.0:1787134781.435010:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+59:11636:x1873946287892864:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134781.435030:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134781.435052:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906c56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070606 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435115:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435131:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435142:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435156:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435190:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435197:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435312:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906c6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435321:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435328:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134781.435372:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787134781.435377:0:11472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134781.435395:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435406:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435415:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435421:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435429:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435435:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134781.435439:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435447:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435459:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:1.0:1787134781.435462:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134781.435466:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435473:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906c5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435500:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435506:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435512:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435517:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134781.435520:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435538:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435548:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa50ade400) 00010000:00010000:1.0:1787134781.435550:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134781.435553:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435558:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7200/0x69932dacae906c64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435600:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6600/0x69932dacae906c56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070606 expref: 61 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435614:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906c6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070606 expref: 60 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.435633:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:1.0:1787134781.435636:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134781.435639:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6000, rc 0) 00000100:00100000:1.0:1787134781.435707:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+60:11636:x1873946287892864:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 698us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134781.435716:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 211 00000100:00100000:0.0:1787134781.439250:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134781.439364:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287892992 00000100:00100000:3.0:1787134781.439376:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287892992 00000100:00100000:3.0:1787134781.439434:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:3.0:1787134781.439443:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+60:2351:x1873946287892992:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134781.439458:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134781.439491:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6000/0x69932dacae906c6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070606 expref: 60 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.439509:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:3.0:1787134781.439513:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134781.439597:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+59:2351:x1873946287892992:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 154us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134781.439605:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:3.0:1787134781.443342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134781.443387:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287893248 00000100:00100000:2.0:1787134781.443398:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287893248 00000100:00100000:2.0:1787134781.443459:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 212 00000100:00100000:2.0:1787134781.443470:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+59:11636:x1873946287893248:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134781.443492:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134781.443513:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907060d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.443639:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.443654:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f8 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.443663:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.443718:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f8 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.443733:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f8 expref: 60 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134781.443747:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942159f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946312002560:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134781.443844:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa44fbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134781.446227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134781.446341:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287893376 00000100:00100000:1.0:1787134781.446351:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287893376 00000100:00100000:2.0:1787134781.446375:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942159f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1873946312002560:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134781.446385:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f8 expref: 61 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.446398:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134781.446423:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:1.0:1787134781.446433:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+61:2352:x1873946287893376:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134781.446447:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134781.446454:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f8 expref: 61 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.446471:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f8 expref: 61 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.446492:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae906c41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705f8 expref: 61 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.446506:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:1.0:1787134781.446511:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.446544:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.446552:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134781.446587:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134781.446605:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134781.446633:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+60:2352:x1873946287893376:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 202us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134781.446641:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 79 00010000:00010000:2.0:1787134781.446707:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134781.446726:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787134781.446880:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907060d expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.446897:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907060d expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.446905:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134781.446907:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787134781.446916:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96400, rc 0) 00000100:00100000:2.0:1787134781.446956:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+60:11636:x1873946287893248:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 3488us (3624us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787134781.446964:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 212 00000100:00100000:0.0:1787134781.449702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134781.450127:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287893632 00000100:00100000:3.0:1787134781.450140:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287893632 00000100:00100000:3.0:1787134781.450255:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:3.0:1787134781.450279:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+60:11636:x1873946287893632:12345-192.168.202.36@tcp:103:lfs.0 00010000:00010000:3.0:1787134781.450297:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134781.450326:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906bd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705e3 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.450343:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:3.0:1787134781.450348:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134781.450411:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486fb1ad-4266-4864-b299-111c5140734b+59:11636:x1873946287893632:12345-192.168.202.36@tcp:103:lfs.0 Request processed in 134us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134781.450419:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:1.0:1787134781.452883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134781.452951:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287893760 00000100:00100000:3.0:1787134781.452962:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287893760 00000100:00100000:3.0:1787134781.453020:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 213 00000100:00100000:3.0:1787134781.453030:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+59:11636:x1873946287893760:12345-192.168.202.36@tcp:58:lfs.0 00010000:00010000:3.0:1787134781.453152:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.453194:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134781.453207:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787134781.453396:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787134781.453481:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+59:11636:x1873946287893760:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 452us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134781.453488:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 213 00000100:00100000:1.0:1787134781.464050:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134781.464144:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287893888 00000100:00100000:2.0:1787134781.464155:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287893888 00000100:00100000:2.0:1787134781.464236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 214 00000100:00100000:2.0:1787134781.464245:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+59:11636:x1873946287893888:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134781.464265:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134781.464285:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070614 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.464340:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.464352:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c8e lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070614 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.464371:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.464384:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c8e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070614 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.464398:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134781.464401:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134781.464405:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c8e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070614 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134781.464430:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96800, rc 0) 00000100:00100000:2.0:1787134781.464503:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+60:11636:x1873946287893888:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 258us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134781.464511:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 214 00010000:00010000:0.0:1787134781.891409:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787134782.466630:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134782.466641:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134782.466683:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787134782.466691:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787134782.466818:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa52a72d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946312002688:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787134782.466938:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81429b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787134782.471712:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa52a72d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946312002688:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787134782.473064:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.473398:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287894016 00000100:00100000:2.0:1787134782.473408:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287894016 00000100:00100000:2.0:1787134782.473491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 215 00000100:00100000:2.0:1787134782.473503:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+60:11637:x1873946287894016:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787134782.473544:0:5835:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787134782.473662:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+60:11637:x1873946287894016:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 161us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.473671:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 215 00000100:00080000:1.0:1787134782.474406:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134782.478350:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.478679:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287894144 00000100:00100000:2.0:1787134782.478703:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287894144 00000100:00100000:2.0:1787134782.478767:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 216 00000100:00100000:2.0:1787134782.478945:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+60:11637:x1873946287894144:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787134782.479032:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479051:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479064:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479080:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479103:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479110:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479137:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479146:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479153:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134782.479223:0:11472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787134782.479228:0:11472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134782.479243:0:11472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479253:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479271:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479278:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479284:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134782.479288:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479306:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479319:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:2.0:1787134782.479322:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134782.479327:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479333:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906c95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479349:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479355:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479361:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479365:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134782.479368:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479374:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479577:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff98aa59e99900) 00010000:00010000:2.0:1787134782.479581:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134782.479585:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479603:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906c9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479620:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479625:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479632:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479636:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134782.479639:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479645:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479653:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134782.479655:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134782.479658:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.479664:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97400/0x69932dacae906ca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.480021:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+60:11637:x1873946287894144:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 1240us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.480030:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 216 00000100:00100000:0.0:1787134782.484012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.484118:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287894400 00000100:00100000:2.0:1787134782.484130:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287894400 00000100:00100000:2.0:1787134782.484317:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 217 00000100:00100000:2.0:1787134782.484329:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa52a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+60:11637:x1873946287894400:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134782.484351:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134782.484371:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906caa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907061b expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484497:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484512:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484533:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134782.484544:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787134782.484654:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484663:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484670:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484676:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134782.484680:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484697:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484728:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134782.484731:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787134782.484738:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484744:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484963:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906caa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907061b expref: 62 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484975:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:2.0:1787134782.484977:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134782.484981:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906caa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907061b expref: 62 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.484993:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97800, rc 0) 00000100:00100000:2.0:1787134782.485055:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa52a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+61:11637:x1873946287894400:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 727us (1053us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787134782.485063:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 217 00000100:00100000:1.0:1787134782.489036:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.489224:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287894528 00000100:00100000:2.0:1787134782.489236:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287894528 00000100:00100000:2.0:1787134782.489307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 218 00000100:00100000:2.0:1787134782.489318:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+61:11637:x1873946287894528:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787134782.489356:0:5835:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787134782.489496:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+61:11637:x1873946287894528:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 179us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.490044:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 218 00000100:00100000:1.0:1787134782.499552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.499930:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287894784 00000100:00100000:2.0:1787134782.499941:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287894784 00000100:00100000:2.0:1787134782.500002:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 219 00000100:00100000:2.0:1787134782.500013:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+61:11637:x1873946287894784:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134782.500037:0:11472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134782.500040:0:11472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787134782.500070:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906c4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705ff expref: 61 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.500091:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134782.500097:0:11472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134782.500111:0:11472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070622 expref: -99 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787134782.500639:0:11472:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787134782.501042:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.501057:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.501067:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.501121:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070622 expref: 63 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.501182:0:11472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070622 expref: 62 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.501191:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134782.501194:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134782.501197:0:11472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96e00, rc 0) 00000100:00100000:2.0:1787134782.501262:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+62:11637:x1873946287894784:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1251us (1721us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787134782.501271:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 219 00000100:00100000:0.0:1787134782.505791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.506455:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287895040 00000100:00100000:2.0:1787134782.506469:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287895040 00000100:00100000:2.0:1787134782.506536:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 220 00000100:00100000:2.0:1787134782.506546:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+62:11637:x1873946287895040:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787134782.506646:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134782.506676:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906cc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070622 expref: 62 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.506708:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa59e99900) 00010000:00010000:2.0:1787134782.506720:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134782.506746:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.506760:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.506771:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.506910:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.506919:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.506927:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507070:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507078:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507085:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507090:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134782.507095:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507101:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507110:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134782.507112:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134782.507116:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507121:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507141:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507146:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507151:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507193:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134782.507197:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507203:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507211:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xce4b3251 (ffff98aa59e99100) 00010000:00010000:2.0:1787134782.507213:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134782.507216:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.507221:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xce4b3251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.507391:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+61:11637:x1873946287895040:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 845us (1621us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787134782.507399:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 220 00000100:00100000:0.0:1787134782.518615:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134782.518718:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287895168 00000100:00100000:3.0:1787134782.518730:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287895168 00000100:00100000:3.0:1787134782.518910:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 221 00000100:00100000:3.0:1787134782.518922:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4daf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+61:11637:x1873946287895168:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134782.518944:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134782.518968:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906ce2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070629 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.519005:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.519020:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.519031:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.519134:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906ce2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070629 expref: 63 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.519153:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070629 expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.519277:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:3.0:1787134782.519280:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787134782.519285:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deba00, rc 0) 00000100:00100000:3.0:1787134782.519347:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4daf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+62:11637:x1873946287895168:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 426us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134782.519355:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 221 00000100:00100000:3.0:1787134782.531400:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.531588:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287895424 00000100:00100000:2.0:1787134782.531599:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287895424 00000100:00100000:2.0:1787134782.531675:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 222 00000100:00100000:2.0:1787134782.531714:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+62:11637:x1873946287895424:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787134782.531845:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.531869:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.531884:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787134782.532228:0:11472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787134782.532240:0:11472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398499080421ns, next at 399499076696ns, rc = 0 00000004:00010000:2.0:1787134782.532338:0:11472:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000039a707ca reply state 0000000045af7020 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.532348:0:11472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134782.532491:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+64:11637:x1873946287895424:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 780us (1102us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787134782.532499:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 222 00010000:00010000:1.0:1787134782.537209:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.537228:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.537236:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.537251:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134782.537258:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.537286:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.537304:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:1.0:1787134782.537308:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787134782.537313:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.537319:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97e00/0x69932dacae906cf0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134782.538708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134782.538958:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287895552 00000100:00100000:0.0:1787134782.538969:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287895552 00000100:00100000:0.0:1787134782.539043:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 223 00000100:00100000:0.0:1787134782.539055:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+63:11637:x1873946287895552:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134782.539080:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134782.539099:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070630 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.539211:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070630 expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.539227:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070630 expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.539279:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:0.0:1787134782.539282:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787134782.539286:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451200, rc 0) 00000100:00100000:0.0:1787134782.539346:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+64:11637:x1873946287895552:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 292us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134782.539353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 223 00000100:00100000:0.0:1787134782.544098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.544669:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287895680 00000100:00100000:2.0:1787134782.544682:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287895680 00000100:00100000:2.0:1787134782.544774:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:2.0:1787134782.544794:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+9:2351:x1873946287895680:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787134782.545129:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+10:2351:x1873946287895680:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 337us (1041us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787134782.545137:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00080000:1.0:1787134782.545654:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134782.549987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134782.550145:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287895936 00000100:00100000:3.0:1787134782.550200:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287895936 00000100:00100000:3.0:1787134782.550260:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:3.0:1787134782.550270:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+64:11637:x1873946287895936:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787134782.550705:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+65:11637:x1873946287895936:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 436us (727us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787134782.550714:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:3.0:1787134782.553917:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.554025:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287896192 00000100:00100000:2.0:1787134782.554042:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287896192 00000100:00100000:2.0:1787134782.554122:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 224 00000100:00100000:2.0:1787134782.554133:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+65:11637:x1873946287896192:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787134782.554292:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+65:11637:x1873946287896192:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 161us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.554300:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 224 00000100:00100000:0.0:1787134782.557074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.557250:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287896320 00000100:00100000:2.0:1787134782.557262:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287896320 00000100:00100000:2.0:1787134782.557353:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 225 00000100:00100000:2.0:1787134782.557364:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+65:11637:x1873946287896320:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134782.557392:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134782.557413:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070637 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.557496:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.557511:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.557531:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134782.557573:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134782.557592:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.557619:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97800/0x69932dacae906cfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070637 expref: 67 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.557659:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070637 expref: 66 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.557669:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:2.0:1787134782.557672:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787134782.557676:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96e00, rc 0) 00000100:00100000:2.0:1787134782.557963:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+66:11637:x1873946287896320:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 600us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.557970:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 225 00000100:00100000:3.0:1787134782.561534:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134782.561649:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287896448 00000100:00100000:1.0:1787134782.561660:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287896448 00000100:00100000:1.0:1787134782.561735:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:1.0:1787134782.561746:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+10:2351:x1873946287896448:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787134782.561765:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134782.561797:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907063e expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787134782.561827:0:11954:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a85833f, blocks: 0x1 00010000:00010000:1.0:1787134782.561851:0:11954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1787134782.561856:0:11954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134782.561867:0:11954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907063e expref: 11 pid: 11954 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.561891:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907063e expref: 11 pid: 11954 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.561925:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6200, rc 0) 00000100:00100000:1.0:1787134782.561998:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+11:2351:x1873946287896448:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 252us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134782.562005:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:3.0:1787134782.568606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134782.568889:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287896704 00000100:00100000:1.0:1787134782.568900:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287896704 00000100:00100000:1.0:1787134782.569003:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 226 00000100:00100000:1.0:1787134782.569015:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+66:11637:x1873946287896704:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787134782.569134:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+66:11637:x1873946287896704:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 121us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134782.569141:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 226 00000100:00100000:3.0:1787134782.573900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.574104:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287896832 00000100:00100000:2.0:1787134782.574116:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287896832 00000100:00100000:2.0:1787134782.574214:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:2.0:1787134782.574225:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+11:11637:x1873946287896832:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134782.574255:0:7839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134782.574277:0:7839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070645 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.574308:0:7839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907063e expref: 12 pid: 11954 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.574317:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134782.574321:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134782.574326:0:7839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 12 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.574397:0:7839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907063e expref: 12 pid: 11954 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.574411:0:7839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907063e expref: 12 pid: 11954 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.574428:0:7839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942159f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7839:1873946312002816:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134782.574528:0:7839:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81454540 going to sleep for 11 seconds 00000100:00100000:2.0:1787134782.578944:0:7839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942159f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7839:1873946312002816:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134782.578989:0:7839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 12 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.579011:0:7839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97800, rc 0) 00000100:00100000:2.0:1787134782.579090:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+12:11637:x1873946287896832:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 4867us (5202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.579100:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:2.0:1787134782.582081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134782.582191:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287896960 00000100:00100000:0.0:1787134782.582203:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287896960 00010000:00010000:0.0:1787134782.582269:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907063e expref: 12 pid: 11954 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134782.582308:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:0.0:1787134782.582318:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+12:2351:x1873946287896960:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134782.582334:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134782.582358:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907063e expref: 12 pid: 11954 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.582373:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907063e expref: 12 pid: 11954 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.582407:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907063e expref: 12 pid: 11954 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.582444:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134782.582458:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134782.582467:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 11 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.582478:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 11 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.582514:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 11 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134782.582965:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1873946312002944:192.168.202.36@tcp:105: 00000100:00100000:0.0:1787134782.583056:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81429b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134782.588886:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134782.589492:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287897088 00000100:00100000:3.0:1787134782.589504:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287897088 00002000:00100000:3.0:1787134782.589580:0:6686:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98a941b14000 x1873946287897088/t0(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:718/0 lens 504/0 e 0 to 0 dl 1787134793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787134782.589594:0:6686:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98a941b14000 with x1873946287897088 ext(0->12) 00002000:00010000:3.0:1787134782.589602:0:6686:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a941b14000 00000100:00100000:3.0:1787134782.589641:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787134782.589653:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486fb1ad-4266-4864-b299-111c5140734b+12:2351:x1873946287897088:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787134782.592230:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1873946312002944:192.168.202.36@tcp:105: 00010000:00010000:0.0:1787134782.592273:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134782.593155:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486fb1ad-4266-4864-b299-111c5140734b+14:2351:x1873946287897088:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 Request processed in 3499us (4382us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787134782.593223:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00002000:00100000:2.0:1787134782.593239:0:6686:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98a941b14000 x1873946287897088/t4294967320(0) o4->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:718/0 lens 504/448 e 0 to 0 dl 1787134793 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787134782.593260:0:6686:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98a941b14000 with x1873946287897088 ext(0->12) 00002000:00010000:2.0:1787134782.593273:0:6686:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a941b14000 00000100:00100000:2.0:1787134782.594323:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+13:2351:x1873946287896960:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 12001us (12250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.594334:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:2.0:1787134782.601591:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134782.602402:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287897216 00000100:00100000:1.0:1787134782.602414:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287897216 00000100:00100000:1.0:1787134782.602483:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 227 00000100:00100000:1.0:1787134782.602493:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+66:11637:x1873946287897216:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787134782.661345:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967483 is committed 00000001:00080000:0.0:1787134782.661363:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000020:00080000:0.0:1787134782.661394:0:5858:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98aa5075b600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787134782.661399:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa47e0d300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98aa5075b0c0 00000020:00080000:0.0:1787134782.661403:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa47e0d700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98aa6fd8e000 00000001:00080000:0.0:1787134782.661413:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1787134782.661417:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:0.0:1787134782.661437:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787134782.661455:0:5858:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98aa524ea6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787134782.661470:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa47beb800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98aa524ea780 00000020:00080000:0.0:1787134782.661473:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa47beb700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98aa6fc28000 00000004:00080000:0.0:1787134782.661485:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:0.0:1787134782.661508:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000100:00100000:2.0:1787134782.661731:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+20:11637:x1873946287897216:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 59235us (60145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.661743:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 227 00000100:00100000:0.0:1787134782.664916:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312003328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787134782.665086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134782.665132:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312003328 00000100:00100000:2.0:1787134782.665142:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312003328 00000100:00100000:2.0:1787134782.665228:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787134782.665238:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1873946312003328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787134782.665440:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787134782.665444:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787134783 00002000:00010000:2.0:1787134782.665447:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787134782.665448:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787134783 -> 1787134783 00002000:00010000:2.0:1787134782.665450:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787134782.665501:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946312003328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 264us (415us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787134782.665507:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1787134782.665546:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98a942158e00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787134782.665551:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312003328:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1787134782.666737:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1787134782.667082:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787134782.667311:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787134782.667333:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312003072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787134782.667559:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134782.667609:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134782.667618:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312003072 00000100:00100000:1.0:1787134782.667618:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94215a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312003200:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787134782.667639:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312003072 00000100:00100000:1.0:1787134782.667649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134782.667705:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787134782.667713:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1873946312003072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787134782.667745:0:6681:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1787134782.667770:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a85833d, atime: 0x6a85833d, ctime: 0x6a85833d, blocks: 0x1 00010000:00010000:2.0:1787134782.667776:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.667791:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1787134782.667794:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134782.667798:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.667810:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.667816:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.667822:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.667835:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787134782.667889:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312003200 00000100:00100000:1.0:1787134782.667894:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312003200 00000100:00100000:1.0:1787134782.667921:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787134782.667928:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312003200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787134782.667944:0:7839:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:2.0:1787134782.668268:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312003072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 555us (709us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787134782.668273:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1787134782.668294:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134782.668299:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.668314:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134782.668317:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.668324:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.668338:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.668342:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5508e43/0x69932dacae906d1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.668357:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134782.668358:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134782.668359:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787134782.668365:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787134782.669097:0:7839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.669119:0:7839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90705a4 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.669128:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787134782.669132:0:7839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134782.669136:0:7839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.669186:0:7839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705a4 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.669204:0:7839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705a4 expref: 12 pid: 6682 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134782.669219:0:7839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7839:1873946312003456:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134782.669304:0:7839:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749600 going to sleep for 11 seconds 00000004:00080000:1.0:1787134782.669360:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa6fd97100/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787134782.669368:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312003072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787134782.672380:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134782.672475:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287897344 00000100:00100000:3.0:1787134782.672486:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287897344 00000100:00100000:3.0:1787134782.672557:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:3.0:1787134782.672574:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+13:2352:x1873946287897344:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787134782.676146:0:7839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7839:1873946312003456:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134782.676207:0:7839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.677848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134782.677915:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287897472 00000100:00100000:1.0:1787134782.677935:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287897472 00010000:00010000:1.0:1787134782.677974:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705a4 expref: 14 pid: 6682 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134782.678011:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:1.0:1787134782.678021:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+14:2352:x1873946287897472:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134782.678038:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134782.678044:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705a4 expref: 14 pid: 6682 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.678058:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705a4 expref: 14 pid: 6682 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.678082:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075b9cd57/0x69932dacae906adc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.36@tcp remote: 0xd233841ac90705a4 expref: 14 pid: 6682 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.678097:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134782.678101:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134782.678105:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.678112:0:7620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.678137:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134782.678219:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+13:2352:x1873946287897472:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 199us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134782.678234:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 81 00010000:00010000:2.0:1787134782.679329:0:7839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.679358:0:7839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.679370:0:7839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.679379:0:7839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.679440:0:7839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787134782.680056:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1873946312003200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12124us (12403us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787134782.680067:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1787134782.680179:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98a94215a680/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787134782.680188:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94215a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312003200:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787134782.680604:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134782.680615:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.680627:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134782.680632:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.680644:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.680665:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.680674:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc359328/0x69932dacae906d21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.680696:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134782.680699:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134782.680701:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134782.706123:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486fb1ad-4266-4864-b299-111c5140734b+12:2352:x1873946287897344:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 33548us (33742us total) trans 0 rc 0/0 00000001:00080000:2.0:1787134782.706128:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:3.0:1787134782.706139:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 68 00000001:00080000:2.0:1787134782.706141:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1787134782.706146:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1787134782.706151:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:2.0:1787134782.706155:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1787134782.711702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134782.711765:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287897728 00000100:00100000:0.0:1787134782.711776:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287897728 00000100:00100000:0.0:1787134782.711842:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 228 00000100:00100000:0.0:1787134782.711852:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+20:11637:x1873946287897728:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787134782.711907:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134782.711936:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070637 expref: 20 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.711958:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:0.0:1787134782.711963:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787134782.711991:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.712004:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.712015:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134782.712466:0:11683:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000c05fa760 reply state 000000001bc3cf47 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134782.712479:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787134782.712647:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+21:11637:x1873946287897728:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 795us (951us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787134782.712677:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 228 00010000:00010000:3.0:1787134782.715905:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.715924:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.715933:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.715940:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134782.715945:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.715953:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.715971:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:3.0:1787134782.715975:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134782.715980:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.715987:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451000/0x69932dacae906d28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.716908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134782.717496:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287897856 00000100:00100000:1.0:1787134782.717508:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287897856 00000100:00100000:1.0:1787134782.717594:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:1.0:1787134782.717606:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+7:2352:x1873946287897856:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787134782.717885:0:11954:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787134782.717889:0:11954:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787134783 -> 1787134781 00002000:00010000:1.0:1787134782.717891:0:11954:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787134781 00002000:00010000:1.0:1787134782.717892:0:11954:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787134783 -> 1787134781 00002000:00010000:1.0:1787134782.717893:0:11954:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787134782.717951:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+8:2352:x1873946287897856:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 348us (1049us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787134782.717956:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:1.0:1787134782.728141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134782.728345:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287898112 00000100:00100000:3.0:1787134782.728370:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287898112 00000100:00100000:3.0:1787134782.728480:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 229 00000100:00100000:3.0:1787134782.728491:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+20:11637:x1873946287898112:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787134782.728588:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.728608:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070629 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.728624:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.728671:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070629 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.728687:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070629 expref: 20 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134782.728703:0:5837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94278b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1873946312003584:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134782.728797:0:5837:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bd98780 going to sleep for 11 seconds 00000100:00100000:1.0:1787134782.742839:0:5837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94278b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1873946312003584:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134782.742872:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134782.744925:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134782.745008:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287898240 00000100:00100000:3.0:1787134782.745023:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287898240 00010000:00010000:3.0:1787134782.745060:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070629 expref: 21 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134782.745097:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:3.0:1787134782.745107:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+21:2351:x1873946287898240:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134782.745122:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134782.745148:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070629 expref: 21 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.745431:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070629 expref: 21 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.745465:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906ce9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070629 expref: 21 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.745480:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:3.0:1787134782.745484:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.745492:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.745497:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.745723:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134782.745786:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486fb1ad-4266-4864-b299-111c5140734b+20:2351:x1873946287898240:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 678us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.745795:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 82 00010000:00010000:1.0:1787134782.745913:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.745921:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.745950:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.745963:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.745968:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.745972:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deac00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134782.745975:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.745982:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.745989:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:1.0:1787134782.745991:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787134782.745994:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.745998:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deac00/0x69932dacae906d2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134782.746051:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+19:11637:x1873946287898112:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 Request processed in 17561us (17920us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787134782.746059:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 229 00000100:00100000:1.0:1787134782.748817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.748893:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287898368 00000100:00100000:2.0:1787134782.748904:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287898368 00000100:00100000:2.0:1787134782.749003:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:2.0:1787134782.749024:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+8:2351:x1873946287898368:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787134782.749079:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.749102:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 8 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.749112:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134782.749116:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787134782.749120:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.749393:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 8 pid: 7839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.749405:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 8 pid: 7839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.749417:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1873946312003712:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134782.749515:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81454540 going to sleep for 11 seconds 00000100:00100000:3.0:1787134782.758378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134782.758490:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287898496 00000100:00100000:1.0:1787134782.758501:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287898496 00010000:00010000:1.0:1787134782.758548:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 9 pid: 7839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134782.758622:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:1.0:1787134782.758641:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287898496:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134782.758660:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134782.758686:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 9 pid: 7839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.758701:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 9 pid: 7839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.758728:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134782.758733:0:7620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134782.758739:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.758749:0:7620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.758770:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134782.758839:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+9:2352:x1873946287898496:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 208us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134782.758847:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 83 00010000:00010000:2.0:1787134782.760344:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd70b5cb/0x69932dacae906d13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070645 expref: 8 pid: 7839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.760375:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1873946312003712:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134782.760400:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.760434:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.760442:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.760488:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.760498:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.760507:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.760514:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134782.760519:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.760528:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.760545:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.760580:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221a35e2/0x69932dacae906d36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.762106:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287898368:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 13084us (13288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.762121:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:3.0:1787134782.764527:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.764814:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287898752 00000100:00100000:2.0:1787134782.764827:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287898752 00000100:00100000:2.0:1787134782.764904:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 230 00000100:00100000:2.0:1787134782.764916:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+19:11637:x1873946287898752:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787134782.765013:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.765034:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.765048:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.767438:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.767602:0:11472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070630 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.767612:0:11472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.767821:0:11472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070630 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.767838:0:11472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070630 expref: 20 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.767858:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946312003840:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134782.767963:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81454540 going to sleep for 11 seconds 00000100:00100000:1.0:1787134782.775366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.775503:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946312003840:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134782.775546:0:11472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134782.775832:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287898880 00000100:00100000:3.0:1787134782.775841:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287898880 00010000:00010000:3.0:1787134782.775879:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070630 expref: 21 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134782.775921:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:3.0:1787134782.775931:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+21:2351:x1873946287898880:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134782.775947:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134782.775967:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070630 expref: 21 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.775980:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070630 expref: 21 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.776004:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906cf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070630 expref: 21 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.776019:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:3.0:1787134782.776025:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.776034:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.776041:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134782.776069:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134782.776135:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+20:2351:x1873946287898880:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 205us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134782.776143:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 84 00010000:00010000:1.0:1787134782.776327:0:11472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.776345:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787134782.776992:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787134782.777212:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787134782.777263:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787134782.777351:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7ae48a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946312003968:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787134782.777412:0:11472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134782.778811:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749480 going to sleep for 11 seconds 00000100:00100000:2.0:1787134782.783428:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312003968 00000100:00100000:2.0:1787134782.783464:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312003968 00000100:00100000:2.0:1787134782.783554:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787134782.783575:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11472:x1873946312003968:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787134782.783774:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11472:x1873946312003968:12345-0@lo:1000:mdt00_003.0 Request processed in 210us (6361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134782.783782:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787134782.785112:0:11472:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1787134782.785125:0:11472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1787134782.785239:0:11472:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98a942158e00, transno 4294967321 00000100:00100000:0.0:1787134782.785258:0:11472:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff98a94215a680 x1873946312003200/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787134798 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134782.785271:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7ae48a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946312003968:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787134782.785918:0:11472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787134782.786049:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946312004096:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787134782.786150:0:11472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134782.786220:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa58dbda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787134782.787258:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312004096 00000100:00100000:1.0:1787134782.787270:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312004096 00000100:00100000:1.0:1787134782.787331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787134782.787343:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11472:x1873946312004096:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787134782.787670:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:11472:x1873946312004096:12345-0@lo:1000:mdt00_003.0 Request processed in 328us (1518us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787134782.787679:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787134782.790915:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11472:1873946312004096:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787134782.790975:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.790986:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.790994:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791000:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134782.791006:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791016:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791037:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa42a7ce00) 00010000:00010000:0.0:1787134782.791040:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787134782.791046:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791072:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97000/0x69932dacae906d44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791118:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791125:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791132:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791137:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134782.791140:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791147:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791156:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:0.0:1787134782.791195:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787134782.791204:0:11472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070614 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791216:0:11472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070614 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791226:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070614 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.791277:0:11472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070614 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134782.791290:0:11472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a941b15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946312004224:192.168.202.36@tcp:105: 00000100:00100000:0.0:1787134782.791381:0:11472:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa58dbda80 going to sleep for 11 seconds 00000100:00100000:0.0:1787134782.801178:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.801724:0:11472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a941b15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11472:1873946312004224:192.168.202.36@tcp:105: 00010000:00010000:2.0:1787134782.801761:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801772:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea000/0x69932dacae906c87 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801825:0:11472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801839:0:11472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801850:0:11472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801860:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801866:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801872:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801878:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134782.801882:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801890:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801901:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134782.801904:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134782.801908:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801914:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae906d4b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801937:0:11472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801943:0:11472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801949:0:11472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801955:0:11472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134782.801958:0:11472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801964:0:11472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801972:0:11472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134782.801974:0:11472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787134782.801977:0:11472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.801984:0:11472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134782.802310:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+23:11637:x1873946287898752:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 37394us (37790us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787134782.802321:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 230 00000020:00080000:2.0:1787134782.802327:0:11472:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787134782.803143:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134782.803150:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134782.803954:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787134782.803970:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787134782.804130:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287899008 00000100:00100000:1.0:1787134782.804146:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287899008 00000100:00100000:1.0:1787134782.804253:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:1.0:1787134782.804265:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+23:11636:x1873946287899008:12345-192.168.202.36@tcp:49:lfs.0 00000100:00100000:1.0:1787134782.804408:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+23:11636:x1873946287899008:12345-192.168.202.36@tcp:49:lfs.0 Request processed in 145us (3264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134782.804416:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:0.0:1787134782.811621:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134782.811757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.811886:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287899264 00000100:00100000:2.0:1787134782.811898:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287899264 00000100:00100000:2.0:1787134782.811979:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:2.0:1787134782.811989:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa515ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+23:11637:x1873946287899264:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787134782.812825:0:5839:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787134782.812947:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787134782.813000:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.813021:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.813035:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.813044:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.813052:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.813059:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134782.813076:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787134782.813217:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa515ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+25:11637:x1873946287899264:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1226us (1607us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787134782.813225:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00000020:00080000:2.0:1787134782.813231:0:5839:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787134782.814363:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134782.814375:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.814385:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96e00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134782.814389:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.814398:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.814415:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98aa59e99100) 00010000:00010000:0.0:1787134782.814418:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787134782.814423:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.814444:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96e00/0x69932dacae906d52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.814465:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134782.814467:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134782.814470:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134782.815654:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287899520 00000100:00100000:1.0:1787134782.815679:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287899520 00000100:00100000:1.0:1787134782.815744:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 231 00000100:00100000:1.0:1787134782.815753:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+25:11636:x1873946287899520:12345-192.168.202.36@tcp:58:lfs.0 00000040:00080000:1.0:1787134782.815993:0:11683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787134782.816091:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+25:11636:x1873946287899520:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 338us (4333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134782.816101:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 231 00000100:00100000:2.0:1787134782.848496:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787134782.848532:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6ff87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312004352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134782.848627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134782.849010:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312004352 00000100:00100000:0.0:1787134782.849021:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312004352 00000100:00100000:0.0:1787134782.849087:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787134782.849098:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946312004352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787134782.849142:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134782.849232:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946312004352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134782.849241:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787134782.849352:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6ff87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312004352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134782.882282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134782.882369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287899648 00000100:00100000:1.0:1787134782.882380:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287899648 00000100:00100000:1.0:1787134782.882442:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 232 00000100:00100000:1.0:1787134782.882452:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+25:11639:x1873946287899648:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134782.882478:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134782.882500:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906d59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907064c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.882591:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.882610:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.882623:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.882877:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.882885:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.882892:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.883252:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.883264:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907060d expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.883271:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.883305:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907060d expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.883321:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907060d expref: 26 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134782.883338:0:5837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7ae4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1873946312004480:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134782.884122:0:5837:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787134782.889985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134782.890081:0:12060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287899904 00000100:00100000:2.0:1787134782.890091:0:12060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287899904 00000100:00100000:2.0:1787134782.890176:0:12060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:2.0:1787134782.890187:0:12060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+27:5590:x1873946287899904:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787134782.890430:0:12060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:486fb1ad-4266-4864-b299-111c5140734b+28:5590:x1873946287899904:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 244us (452us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787134782.890438:0:12060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:3.0:1787134782.892537:0:5837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7ae4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1873946312004480:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134782.892580:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134782.892930:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134782.893041:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287900032 00000100:00100000:1.0:1787134782.893050:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287900032 00010000:00010000:1.0:1787134782.893089:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907060d expref: 28 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134782.893199:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:1.0:1787134782.893210:0:7620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+28:2351:x1873946287900032:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134782.893227:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134782.893236:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907060d expref: 28 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.893268:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907060d expref: 28 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.893291:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae906c79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907060d expref: 28 pid: 5835 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.893309:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:1.0:1787134782.893314:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.893324:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.893331:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134782.893352:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134782.893414:0:7620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:486fb1ad-4266-4864-b299-111c5140734b+27:2351:x1873946287900032:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 205us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134782.893422:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 85 00010000:00010000:0.0:1787134782.893484:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893493:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134782.893547:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787134782.893552:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134782.893582:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893607:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893617:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893624:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893640:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893646:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134782.893650:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893667:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893677:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134782.893680:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134782.893684:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893689:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae906d60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893699:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893704:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893716:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893722:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134782.893724:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893730:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893738:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98aa50ade900) 00010000:00010000:0.0:1787134782.893740:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134782.893744:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893750:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7400/0x69932dacae906d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893787:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae906d59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907064c expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893801:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907064c expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134782.893808:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:0.0:1787134782.893810:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134782.893813:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7800, rc 0) 00000100:00100000:0.0:1787134782.893840:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+26:11639:x1873946287899648:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 11390us (11569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134782.893855:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 232 00010000:00010000:1.0:1787134782.912351:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787134783.723769:0:12611:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134783.723781:0:12611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134783.723829:0:12611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787134783.723835:0:12611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787134783.808464:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134783.808474:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134783.808512:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787134783.808519:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787134783.808655:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa740b0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946312004608:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787134783.808772:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa58dbd180 going to sleep for 11 seconds 00000100:00100000:2.0:1787134783.815389:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa740b0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1873946312004608:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787134783.821961:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134783.822236:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287900160 00000100:00100000:1.0:1787134783.822246:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287900160 00000100:00100000:1.0:1787134783.822384:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 233 00000100:00100000:1.0:1787134783.822399:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+26:11651:x1873946287900160:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787134783.822438:0:11472:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787134783.822551:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486fb1ad-4266-4864-b299-111c5140734b+26:11651:x1873946287900160:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 154us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134783.822576:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 233 00000100:00100000:3.0:1787134783.835284:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134783.835408:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287900416 00000100:00100000:0.0:1787134783.835419:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287900416 00000100:00100000:0.0:1787134783.835469:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 234 00000100:00100000:0.0:1787134783.835479:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+26:11651:x1873946287900416:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134783.835498:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134783.835519:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906d75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070653 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.835630:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906d7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.835646:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906d7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.835659:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906d7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134783.835682:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787134783.835963:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae906d75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070653 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.835982:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906d7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070653 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.835991:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:0.0:1787134783.835994:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134783.835998:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451200, rc 0) 00000100:00100000:0.0:1787134783.837422:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+28:11651:x1873946287900416:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1932us (2135us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787134783.837434:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 234 00000100:00100000:2.0:1787134783.848672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134783.848970:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287900544 00000100:00100000:1.0:1787134783.848985:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287900544 00000100:00100000:1.0:1787134783.849056:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:1.0:1787134783.849066:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+28:2350:x1873946287900544:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134783.849082:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134783.849108:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451200/0x69932dacae906d7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070653 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134783.849127:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:1.0:1787134783.849132:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134783.849211:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486fb1ad-4266-4864-b299-111c5140734b+27:2350:x1873946287900544:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 146us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134783.849219:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:2.0:1787134783.850847:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134783.850978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287900800 00000100:00100000:0.0:1787134783.850987:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287900800 00000100:00100000:0.0:1787134783.851045:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 235 00000100:00100000:0.0:1787134783.851055:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+27:11651:x1873946287900800:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787134783.851138:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.851197:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.851211:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.851484:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.851500:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.851507:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.851514:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134783.851519:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.851526:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.851539:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:0.0:1787134783.851541:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787134783.851546:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134783.851552:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae906d8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134783.851701:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+28:11651:x1873946287900800:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 646us (860us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787134783.851709:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 235 00000040:00080000:2.0:1787134783.852081:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787134783.852086:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787134783.853448:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787134783.853467:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787134783.856913:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134783.857039:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287901056 00000100:00100000:2.0:1787134783.857050:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287901056 00000100:00100000:2.0:1787134783.857112:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:2.0:1787134783.857124:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+28:11651:x1873946287901056:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787134783.857482:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+29:11651:x1873946287901056:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 360us (578us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787134783.857489:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 64 00010000:00010000:0.0:1787134783.936465:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134784.390087:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312004992:0@lo:400:kworker.0 00000100:00100000:2.0:1787134784.390181:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134784.390262:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787134784.390269:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312005120:0@lo:400:kworker.0 00000100:00100000:2.0:1787134784.390316:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134784.390355:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312005120 00000100:00100000:2.0:1787134784.390362:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312005120 00000100:00100000:2.0:1787134784.390422:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787134784.390432:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946312005120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134784.390491:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946312005120:12345-0@lo:400:kworker.0 Request processed in 60us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134784.390499:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1787134784.390520:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134784.390565:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312005120:0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.391570:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312004736:0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.391641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134784.391692:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312005248:0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.391719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134784.391747:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787134784.391767:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946312004864:0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.391790:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134784.391815:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a941b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312005376:0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.391839:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134784.391891:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312005376 00000100:00100000:1.0:1787134784.391897:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312005376 00000100:00100000:1.0:1787134784.391941:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787134784.391950:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312005376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.391993:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312005376:12345-0@lo:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134784.392013:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787134784.392035:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312004992 00000100:00100000:1.0:1787134784.392039:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312004992 00000100:00100000:1.0:1787134784.392067:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312005248 00000100:00100000:1.0:1787134784.392070:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312005248 00000100:00100000:1.0:1787134784.392087:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312004864 00000100:00100000:1.0:1787134784.392090:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312004864 00000100:00100000:1.0:1787134784.392103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787134784.392109:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312004992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.392147:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312004992:12345-0@lo:400:kworker.0 Request processed in 38us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134784.392154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787134784.392199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787134784.392206:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312005248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.394527:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312005248:12345-0@lo:400:kworker.0 Request processed in 2309us (2795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134784.394543:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787134784.394587:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787134784.394599:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946312004864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.394658:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946312004864:12345-0@lo:400:kworker.0 Request processed in 64us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134784.394681:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:1.0:1787134784.394718:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787134784.394723:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134784.394769:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312004992:0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.394805:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946312004864:0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.394818:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a941b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312005376:0@lo:400:kworker.0 00000100:00100000:1.0:1787134784.394827:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312005248:0@lo:400:kworker.0 00000100:00100000:2.0:1787134784.397816:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312004736 00000100:00100000:2.0:1787134784.397833:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312004736 00000100:00100000:2.0:1787134784.397907:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787134784.397918:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946312004736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134784.398028:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa472a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946312004736:12345-0@lo:400:kworker.0 Request processed in 112us (6386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134784.398036:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787134784.398104:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312004736:0@lo:400:kworker.0 00000001:00080000:1.0:1787134784.501607:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787134784.501637:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1787134784.501645:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1787134784.900195:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787134784.900233:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312005504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134784.900311:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134784.900750:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312005504 00000100:00100000:2.0:1787134784.900759:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312005504 00000100:00100000:2.0:1787134784.900815:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787134784.900824:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873946312005504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787134784.900859:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134784.900909:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873946312005504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134784.900916:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787134784.901089:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312005504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787134784.965131:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134785.271365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134785.271399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134785.271429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134785.271451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134785.271483:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287901184 00000100:00100000:3.0:1787134785.271496:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287901184 00000100:00100000:0.0:1787134785.271562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134785.271574:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 306 00000100:00100000:3.0:1787134785.271586:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287901184:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134785.271600:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287901440 00000100:00100000:0.0:1787134785.271606:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287901440 00000100:00100000:0.0:1787134785.271644:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287901568 00000100:00100000:0.0:1787134785.271647:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287901568 00000100:00100000:0.0:1787134785.271670:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 107 00000100:00100000:3.0:1787134785.271673:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287901184:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 77us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134785.271681:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287901440:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134785.271688:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 306 00000100:00100000:0.0:1787134785.271715:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287901440:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 36us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134785.271721:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 107 00000100:00100000:0.0:1787134785.271734:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00100000:0.0:1787134785.271740:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2349:x1873946287901568:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134785.271765:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2349:x1873946287901568:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 25us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134785.271771:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00080000:0.0:1787134785.276402:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134785.276413:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134785.276435:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287901312 00000100:00100000:0.0:1787134785.276446:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287901312 00000100:00100000:0.0:1787134785.276554:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287901696 00000100:00100000:0.0:1787134785.276558:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287901696 00000100:00100000:0.0:1787134785.276587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 183 00000100:00100000:0.0:1787134785.276606:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa740b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+29:2349:x1873946287901312:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134785.276729:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa740b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+29:2349:x1873946287901312:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 124us (5329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134785.276738:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 183 00000100:00100000:0.0:1787134785.276756:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 184 00000100:00100000:0.0:1787134785.276762:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287901696:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134785.276790:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2349:x1873946287901696:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (5229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134785.276796:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 184 00000100:00080000:3.0:1787134785.277242:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787134785.698487:0:12666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787134785.698502:0:12666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787134785.698567:0:12666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787134785.698577:0:12666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787134785.895154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134785.895254:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287901952 00000100:00100000:2.0:1787134785.895266:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287901952 00000100:00100000:2.0:1787134785.895334:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 236 00000100:00100000:2.0:1787134785.895345:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+29:11671:x1873946287901952:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134785.895367:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134785.895388:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906d91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907065a expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134785.895505:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906d98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134785.895521:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906d98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134785.895544:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906d98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134785.895559:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787134785.895710:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae906d91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907065a expref: 32 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134785.895729:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906d98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907065a expref: 31 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134785.895738:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:2.0:1787134785.895741:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787134785.895754:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96600, rc 0) 00000100:00100000:2.0:1787134785.895835:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+31:11671:x1873946287901952:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 492us (690us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787134785.895844:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 236 00000100:00100000:0.0:1787134785.903855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134785.903937:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287902080 00000100:00100000:3.0:1787134785.903949:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287902080 00000100:00100000:3.0:1787134785.904011:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 237 00000100:00100000:3.0:1787134785.904022:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7424a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+31:11671:x1873946287902080:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:3.0:1787134785.904122:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134785.904141:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134785.904153:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134785.904220:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134785.904228:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134785.904235:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134785.904256:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deba00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134785.904260:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134785.904267:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134785.904279:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:3.0:1787134785.904281:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787134785.904286:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134785.904292:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59deba00/0x69932dacae906da6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134785.904364:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7424a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+31:11671:x1873946287902080:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 343us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134785.904372:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 237 00010000:00010000:0.0:1787134785.985526:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134786.020325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134786.020533:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287902208 00000100:00100000:0.0:1787134786.020553:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287902208 00000100:00100000:0.0:1787134786.020620:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:0.0:1787134786.020632:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+7:2350:x1873946287902208:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:0.0:1787134786.020653:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134786.020676:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066ac3d33/0x69932dacae906dad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070661 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787134786.020704:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a85833d, atime: 0x6a85833d, ctime: 0x6a85833d, blocks: 0xb 00010000:00010000:0.0:1787134786.020724:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1787134786.020729:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134786.020739:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ac3d33/0x69932dacae906dad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070661 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134786.020759:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066ac3d33/0x69932dacae906dad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070661 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134786.020802:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450400, rc 0) 00000100:00100000:0.0:1787134786.020880:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486fb1ad-4266-4864-b299-111c5140734b+8:2350:x1873946287902208:12345-192.168.202.36@tcp:101:cat.0 Request processed in 251us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134786.020888:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:3.0:1787134786.034103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134786.034450:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287902336 00000100:00100000:1.0:1787134786.034462:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287902336 00002000:00100000:1.0:1787134786.034543:0:6687:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98aa7f66ce00 x1873946287902336/t0(0) o3->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:722/0 lens 488/0 e 0 to 0 dl 1787134797 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787134786.034555:0:6687:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa7f66ce00 with x1873946287902336 ext(0->4095) 00002000:00010000:1.0:1787134786.034562:0:6687:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa7f66ce00 00000100:00100000:1.0:1787134786.034598:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:1.0:1787134786.034609:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486fb1ad-4266-4864-b299-111c5140734b+8:2349:x1873946287902336:12345-192.168.202.36@tcp:3:cat.0 00000100:00100000:1.0:1787134786.034869:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486fb1ad-4266-4864-b299-111c5140734b+8:2349:x1873946287902336:12345-192.168.202.36@tcp:3:cat.0 Request processed in 261us (778us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787134786.034877:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00002000:00100000:1.0:1787134786.034884:0:6687:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98aa7f66ce00 x1873946287902336/t0(0) o3->486fb1ad-4266-4864-b299-111c5140734b@192.168.202.36@tcp:722/0 lens 488/4536 e 0 to 0 dl 1787134797 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787134786.034902:0:6687:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa7f66ce00 with x1873946287902336 ext(0->4095) 00002000:00010000:1.0:1787134786.034906:0:6687:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa7f66ce00 00010000:00010000:1.0:1787134787.014975:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134787.978787:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312005632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134787.978863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134787.992899:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312005632 00000100:00100000:0.0:1787134787.992919:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312005632 00000100:00100000:0.0:1787134787.993003:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787134787.993182:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312005632:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787134787.993291:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787134787.993883:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134787.993982:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312005632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 969us (15116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134787.993991:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787134787.995541:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787134787.995553:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787134787.995582:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98aa6fd97100, transno 4294967310 00000100:00100000:1.0:1787134788.002910:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312005632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787134788.033863:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787134788.165034:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1787134788.165052:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1787134788.257945:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:0.0:1787134788.257967:0:5858:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98aa5075b0c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787134788.257973:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa458c7b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98aa551bb000 00000020:00080000:0.0:1787134788.257976:0:5858:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98aa458c7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98a942d52c00 00000020:00080000:1.0:1787134788.258032:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1787134788.258254:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787134788.261555:0:5858:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1787134788.261778:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00010000:00010000:0.0:1787134789.063602:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134789.507577:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a941b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312006016:0@lo:400:kworker.0 00000100:00100000:1.0:1787134789.507669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134789.507734:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787134789.507740:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312006144:0@lo:400:kworker.0 00000100:00100000:1.0:1787134789.507764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134789.507892:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa74249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312005760:0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.507925:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134789.507947:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94278b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312006272:0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.507966:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134789.507993:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787134789.507998:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946312005888:0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.508027:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134789.508044:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312006400:0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.508062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134789.508084:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312006016 00000100:00100000:2.0:1787134789.508092:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312006016 00000100:00100000:2.0:1787134789.508138:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312006272 00000100:00100000:2.0:1787134789.508141:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312006272 00000100:00100000:2.0:1787134789.508172:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312005888 00000100:00100000:2.0:1787134789.508438:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312005888 00000100:00100000:2.0:1787134789.508462:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787134789.508470:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312006016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.508534:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312006016:12345-0@lo:400:kworker.0 Request processed in 63us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134789.508541:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787134789.508570:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787134789.508575:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312006272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.508605:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312006272:12345-0@lo:400:kworker.0 Request processed in 30us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134789.508611:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787134789.508628:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787134789.508635:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946312005888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.508664:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946312005888:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134789.508672:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787134789.508721:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946312005888:0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.508731:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94278b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312006272:0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.508774:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312006144 00000100:00100000:2.0:1787134789.508777:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312006144 00000100:00100000:3.0:1787134789.509453:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312005760 00000100:00100000:3.0:1787134789.509460:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312005760 00000100:00100000:3.0:1787134789.509487:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787134789.509494:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946312005760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134789.509552:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946312005760:12345-0@lo:400:kworker.0 Request processed in 58us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134789.509558:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787134789.509644:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa74249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312005760:0@lo:400:kworker.0 00000100:00080000:1.0:1787134789.509778:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787134789.509784:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134789.509815:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a941b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312006016:0@lo:400:kworker.0 00000100:00100000:2.0:1787134789.511706:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312006400 00000100:00100000:2.0:1787134789.511719:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312006400 00000100:00080000:1.0:1787134789.511918:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134789.516489:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787134789.516561:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312006144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134789.516693:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312006144:12345-0@lo:400:kworker.0 Request processed in 161us (8927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134789.516700:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787134789.516722:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787134789.516729:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312006400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134789.516764:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312006400:12345-0@lo:400:kworker.0 Request processed in 36us (8701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134789.516770:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787134789.516818:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787134789.516823:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98a94215a680, transno 4294967322 00000004:00080000:3.0:1787134789.516836:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787134789.516874:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312006400:0@lo:400:kworker.0 00000100:00100000:1.0:1787134789.518907:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312006144:0@lo:400:kworker.0 00000100:00100000:1.0:1787134790.016772:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a94215a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312006528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134790.016863:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134790.017186:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312006528 00000100:00100000:0.0:1787134790.017196:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312006528 00000100:00100000:0.0:1787134790.017281:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787134790.017291:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94377f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312006528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787134790.017326:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134790.017381:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94377f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312006528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134790.017390:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787134790.017609:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a94215a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312006528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134790.080415:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134790.394008:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134790.394087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134790.394117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134790.394145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134790.394185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134790.394215:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287902976 00000100:00100000:0.0:1787134790.394223:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287902976 00000100:00100000:0.0:1787134790.394279:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287902592 00000100:00100000:0.0:1787134790.394282:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287902592 00000100:00100000:0.0:1787134790.394300:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 188 00000100:00100000:0.0:1787134790.394309:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287902976:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134790.394402:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2350:x1873946287902976:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 93us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134790.394409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 188 00000100:00100000:0.0:1787134790.394422:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 189 00000100:00100000:0.0:1787134790.394427:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+18:2350:x1873946287902592:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134790.394458:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486fb1ad-4266-4864-b299-111c5140734b+18:2350:x1873946287902592:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134790.394463:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 189 00000100:00100000:0.0:1787134790.394540:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287902720 00000100:00100000:0.0:1787134790.394543:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287902720 00000100:00100000:0.0:1787134790.394568:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287902848 00000100:00100000:0.0:1787134790.394571:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287902848 00000100:00100000:0.0:1787134790.394587:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 111 00000100:00100000:0.0:1787134790.394592:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2350:x1873946287902720:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134790.394616:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2350:x1873946287902720:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134790.394621:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 111 00000100:00100000:0.0:1787134790.394628:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 112 00000100:00100000:0.0:1787134790.394633:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+7:2350:x1873946287902848:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134790.394648:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+7:2350:x1873946287902848:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 15us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134790.394653:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 112 00000100:00080000:1.0:1787134790.394888:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787134790.394893:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787134790.394896:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134790.399503:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287902464 00000100:00100000:3.0:1787134790.399522:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287902464 00000100:00100000:0.0:1787134790.408345:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 308 00000100:00100000:0.0:1787134790.408359:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287902464:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134790.408476:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287902464:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 119us (14476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134790.408484:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 308 00010000:00010000:0.0:1787134791.104481:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134791.651477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134791.651576:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287903104 00000100:00100000:1.0:1787134791.651586:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287903104 00000100:00100000:1.0:1787134791.651647:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 238 00000100:00100000:1.0:1787134791.651657:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+18:11316:x1873946287903104:12345-192.168.202.36@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787134791.651761:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+18:11316:x1873946287903104:12345-192.168.202.36@tcp:60:lhsmtool_posix.0 Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134791.651770:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 238 00000100:00100000:0.0:1787134791.653914:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134791.654003:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287903360 00000100:00100000:2.0:1787134791.654012:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287903360 00000100:00100000:2.0:1787134791.654068:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:2.0:1787134791.654080:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+18:11316:x1873946287903360:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787134791.654765:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+19:11316:x1873946287903360:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 685us (858us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787134791.654774:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:3.0:1787134791.886623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134791.886893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287903488 00000100:00100000:0.0:1787134791.886905:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287903488 00000100:00100000:0.0:1787134791.886979:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 239 00000100:00100000:0.0:1787134791.886991:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+5:12123:x1873946287903488:12345-192.168.202.36@tcp:101:lsof.0 00010000:00010000:0.0:1787134791.887022:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134791.887046:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906db4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070668 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134791.887110:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906dbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134791.887124:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134791.887135:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134791.887376:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787134791.887380:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134791.887460:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134791.887500:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450600/0x69932dacae906db4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070668 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134791.887519:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906dbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070668 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134791.887528:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cc00) 00010000:00010000:0.0:1787134791.887530:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787134791.887535:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451400, rc 0) 00000100:00100000:0.0:1787134791.887612:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:602cf179-3fa4-4e4c-92db-c355fb291830+6:12123:x1873946287903488:12345-192.168.202.36@tcp:101:lsof.0 Request processed in 623us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134791.887619:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 239 00010000:00010000:0.0:1787134792.128362:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134793.090585:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312006656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134793.090671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134793.090867:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312006656 00000100:00100000:2.0:1787134793.090885:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312006656 00000100:00080000:0.0:1787134793.091077:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134793.091099:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787134793.091141:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312006656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787134793.091200:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134793.098382:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312006656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7263us (7700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134793.098399:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787134793.100299:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312006656:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787134793.152364:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787134793.152377:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787134793.153250:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1787134793.153262:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787134793.156991:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787134793.172478:0:5858:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1787134793.172515:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787134793.172580:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787134793.172603:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787134794.177447:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134794.625062:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312007168:0@lo:400:kworker.0 00000100:00100000:0.0:1787134794.625189:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134794.625273:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787134794.625281:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312007040:0@lo:400:kworker.0 00000100:00100000:0.0:1787134794.625320:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134794.625491:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312006912:0@lo:400:kworker.0 00000100:00100000:2.0:1787134794.625525:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134794.625555:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312007424:0@lo:400:kworker.0 00000100:00100000:2.0:1787134794.625580:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134794.625611:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787134794.625617:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312006784:0@lo:400:kworker.0 00000100:00100000:2.0:1787134794.625648:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134794.625667:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312007296:0@lo:400:kworker.0 00000100:00100000:2.0:1787134794.625688:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134794.625719:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312007168 00000100:00100000:2.0:1787134794.625728:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312007168 00000100:00100000:2.0:1787134794.625783:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312007424 00000100:00100000:2.0:1787134794.625786:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312007424 00000100:00100000:2.0:1787134794.625821:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787134794.625832:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312007168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134794.625915:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312007168:12345-0@lo:400:kworker.0 Request processed in 84us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134794.625924:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787134794.625942:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787134794.625948:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94278b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312007424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134794.626000:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94278b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312007424:12345-0@lo:400:kworker.0 Request processed in 52us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134794.626007:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787134794.626053:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312007424:0@lo:400:kworker.0 00000100:00100000:1.0:1787134794.626229:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312007040 00000100:00100000:1.0:1787134794.626236:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312007040 00000100:00100000:1.0:1787134794.626281:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312006912 00000100:00100000:1.0:1787134794.626284:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312006912 00000100:00100000:1.0:1787134794.626306:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312007296 00000100:00100000:1.0:1787134794.626308:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312007296 00000100:00100000:1.0:1787134794.626323:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787134794.626329:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312007040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134794.626366:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312007040:12345-0@lo:400:kworker.0 Request processed in 37us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134794.626372:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787134794.626384:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787134794.626390:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a94215a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312006912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134794.626418:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a94215a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312006912:12345-0@lo:400:kworker.0 Request processed in 28us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134794.626433:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787134794.626443:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787134794.626450:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312007296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134794.626514:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312007296:12345-0@lo:400:kworker.0 Request processed in 65us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134794.626520:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:0.0:1787134794.626989:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787134794.626996:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134794.627030:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312007040:0@lo:400:kworker.0 00000100:00100000:0.0:1787134794.627044:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312007168:0@lo:400:kworker.0 00000100:00100000:2.0:1787134794.627144:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312007296:0@lo:400:kworker.0 00000100:00100000:2.0:1787134794.627155:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312006912:0@lo:400:kworker.0 00000100:00100000:3.0:1787134794.628136:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312006784 00000100:00100000:3.0:1787134794.628149:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312006784 00000100:00100000:3.0:1787134794.628230:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787134794.628240:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946312006784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134794.628338:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946312006784:12345-0@lo:400:kworker.0 Request processed in 100us (2689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134794.628345:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787134794.628681:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312006784:0@lo:400:kworker.0 00000100:00100000:1.0:1787134795.136363:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134795.136397:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312007552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134795.136489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134795.136638:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312007552 00000100:00100000:2.0:1787134795.136649:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312007552 00000100:00100000:2.0:1787134795.136716:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787134795.136736:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312007552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787134795.136778:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134795.136842:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312007552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134795.136849:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787134795.136993:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312007552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134795.200630:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134795.526318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134795.526370:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134795.526401:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134795.526445:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134795.526483:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134795.526530:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287903872 00000100:00100000:3.0:1787134795.526541:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287903872 00000100:00100000:3.0:1787134795.526618:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287904000 00000100:00100000:3.0:1787134795.526621:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287904000 00000100:00100000:1.0:1787134795.527140:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:1.0:1787134795.527170:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287903872:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134795.527249:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+5:2349:x1873946287903872:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 98us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134795.527257:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:1.0:1787134795.527277:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:1.0:1787134795.527282:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2349:x1873946287904000:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134795.527303:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486fb1ad-4266-4864-b299-111c5140734b+7:2349:x1873946287904000:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 22us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134795.527309:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:1.0:1787134795.527327:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287904128 00000100:00100000:1.0:1787134795.527331:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287904128 00000100:00100000:1.0:1787134795.527364:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287903744 00000100:00100000:1.0:1787134795.527367:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287903744 00000100:00100000:1.0:1787134795.527402:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 193 00000100:00100000:1.0:1787134795.527408:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:602cf179-3fa4-4e4c-92db-c355fb291830+6:2349:x1873946287904128:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134795.527438:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:602cf179-3fa4-4e4c-92db-c355fb291830+6:2349:x1873946287904128:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 30us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134795.527445:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 193 00000100:00100000:1.0:1787134795.527472:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 194 00000100:00100000:1.0:1787134795.527478:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+18:2349:x1873946287903744:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134795.527520:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:486fb1ad-4266-4864-b299-111c5140734b+18:2349:x1873946287903744:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 43us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134795.527526:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 194 00000100:00080000:1.0:1787134795.528230:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787134795.528239:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787134795.528242:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134795.528780:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287903616 00000100:00100000:2.0:1787134795.528791:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287903616 00000100:00100000:2.0:1787134795.528856:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 310 00000100:00100000:2.0:1787134795.528865:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287903616:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134795.528925:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2349:x1873946287903616:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 62us (2618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134795.528933:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 310 00010000:00010000:0.0:1787134796.225045:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787134796.323334:0:12866:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:19:54 (1787134794) 00010000:00010000:1.0:1787134797.256667:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134798.209219:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312007680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134798.209295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134798.209578:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312007680 00000100:00100000:0.0:1787134798.209680:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312007680 00000100:00100000:0.0:1787134798.210199:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787134798.210214:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312007680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787134798.210270:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787134798.210344:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312007680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134798.210353:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787134798.210416:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312007680:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787134798.214270:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787134798.272332:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134799.297368:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134799.747235:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312007808:0@lo:400:kworker.0 00000100:00100000:1.0:1787134799.747235:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312008064:0@lo:400:kworker.0 00000100:00100000:0.0:1787134799.747323:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312007936:0@lo:400:kworker.0 00000100:00100000:2.0:1787134799.747713:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312008192:0@lo:400:kworker.0 00000100:00100000:1.0:1787134799.752785:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134799.752889:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312008064 00000100:00100000:1.0:1787134799.752899:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312008064 00000100:00100000:1.0:1787134799.752952:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787134799.752962:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a941b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312008064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134799.753018:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a941b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312008064:12345-0@lo:400:kworker.0 Request processed in 58us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134799.753025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1787134799.753043:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134799.753088:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312008064:0@lo:400:kworker.0 00000100:00100000:0.0:1787134799.756565:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134799.756643:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312008448:0@lo:400:kworker.0 00000100:00100000:0.0:1787134799.756683:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134799.756695:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312007936 00000100:00100000:1.0:1787134799.756728:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312007936 00000100:00100000:0.0:1787134799.756736:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312008448 00000100:00100000:0.0:1787134799.756738:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312008448 00000100:00100000:1.0:1787134799.756795:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787134799.756803:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787134799.756808:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312007936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134799.756809:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312008448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134799.756874:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312008448:12345-0@lo:400:kworker.0 Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134799.756881:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1787134799.756912:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134799.763463:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312007936:12345-0@lo:400:kworker.0 Request processed in 6644us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134799.763481:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787134799.763672:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134799.763732:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312008320:0@lo:400:kworker.0 00000100:00100000:1.0:1787134799.763763:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312007808 00000100:00100000:1.0:1787134799.763771:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312007808 00000100:00100000:1.0:1787134799.763812:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787134799.763822:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946312007808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134799.763931:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312007936:0@lo:400:kworker.0 00000100:00100000:0.0:1787134799.763947:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312008448:0@lo:400:kworker.0 00000100:00100000:2.0:1787134799.765183:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134799.768121:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312008192 00000100:00100000:0.0:1787134799.768141:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312008192 00000100:00100000:0.0:1787134799.768271:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787134799.768283:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312008192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134799.768421:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312008192:12345-0@lo:400:kworker.0 Request processed in 129us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134799.768447:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787134799.768501:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312008192:0@lo:400:kworker.0 00000100:00100000:1.0:1787134799.771078:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3309:x1873946312007808:12345-0@lo:400:kworker.0 Request processed in 7247us (7395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134799.771093:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787134799.785539:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134799.785630:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312008320 00000100:00100000:1.0:1787134799.785641:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312008320 00000100:00100000:3.0:1787134799.785655:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312007808:0@lo:400:kworker.0 00000100:00100000:1.0:1787134799.785718:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787134799.785729:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312008320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134799.785810:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312008320:12345-0@lo:400:kworker.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134799.785817:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1787134799.785926:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134799.790333:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312008320:0@lo:400:kworker.0 00000100:00100000:0.0:1787134800.256550:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787134800.256578:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312008576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134800.256677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134800.257070:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312008576 00000100:00100000:3.0:1787134800.257079:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312008576 00000100:00100000:3.0:1787134800.257143:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787134800.257152:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312008576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134800.257229:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134800.257291:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312008576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134800.257300:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787134800.257540:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312008576:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787134800.320591:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134800.653865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134800.653909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134800.653951:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134800.653971:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134800.653998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134800.654064:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287904640 00000100:00100000:3.0:1787134800.654088:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287904640 00000100:00100000:3.0:1787134800.654198:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287904512 00000100:00100000:3.0:1787134800.654202:0:11954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287904512 00000100:00100000:3.0:1787134800.654229:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:3.0:1787134800.654240:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287904640:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134800.654330:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+7:2351:x1873946287904640:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134800.654338:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:3.0:1787134800.654355:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:3.0:1787134800.654361:0:11954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+5:2348:x1873946287904512:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:3.0:1787134800.654381:0:11954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae90610b 00000100:00080000:3.0:1787134800.654389:0:11954:0:(import.c:65:import_set_state_nolock()) ffff98aa7ae05800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787134800.654443:0:11954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787134800.654699:0:11954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:486fb1ad-4266-4864-b299-111c5140734b+2:2348:x1873946287904512:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 337us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134800.654706:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 72 00010000:00010000:3.0:1787134800.654730:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134800.654993:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287904256 00000100:00100000:1.0:1787134800.654998:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287904256 00000100:00100000:1.0:1787134800.655040:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 312 00000100:00100000:1.0:1787134800.655048:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287904256:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134800.655078:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2352:x1873946287904256:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 31us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134800.655085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 312 00000100:00100000:1.0:1787134800.655142:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287904384 00000100:00100000:1.0:1787134800.655146:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287904384 00000100:00100000:1.0:1787134800.655204:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287904768 00000100:00100000:1.0:1787134800.655207:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287904768 00000100:00100000:1.0:1787134800.655229:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 198 00000100:00100000:1.0:1787134800.655236:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+18:2352:x1873946287904384:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134800.655267:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486fb1ad-4266-4864-b299-111c5140734b+18:2352:x1873946287904384:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134800.655274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 198 00000100:00100000:1.0:1787134800.655285:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 199 00000100:00100000:1.0:1787134800.655291:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+6:2351:x1873946287904768:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134800.655315:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:602cf179-3fa4-4e4c-92db-c355fb291830+6:2351:x1873946287904768:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134800.655320:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 199 00000100:00080000:0.0:1787134800.656912:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787134800.656922:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134800.656925:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134801.295700:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134801.295894:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287905024 00000100:00100000:2.0:1787134801.295904:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287905024 00000100:00100000:2.0:1787134801.295966:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00100000:2.0:1787134801.295977:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+18:12346:x1873946287905024:12345-192.168.202.36@tcp:35:umount.0 00000100:00100000:2.0:1787134801.296850:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+19:12346:x1873946287905024:12345-192.168.202.36@tcp:35:umount.0 Request processed in 874us (1158us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787134801.296857:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00100000:1.0:1787134801.301871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134801.302008:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287905280 00000100:00100000:0.0:1787134801.302018:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287905280 00000100:00100000:0.0:1787134801.302119:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:0.0:1787134801.302130:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+19:12346:x1873946287905280:12345-192.168.202.36@tcp:35:umount.0 00000100:00100000:0.0:1787134801.302723:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+20:12346:x1873946287905280:12345-192.168.202.36@tcp:35:umount.0 Request processed in 593us (861us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787134801.302732:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:3.0:1787134801.307089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134801.307152:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287905536 00000100:00100000:2.0:1787134801.307180:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287905536 00000100:00100000:2.0:1787134801.307734:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:2.0:1787134801.307746:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa515fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+20:12346:x1873946287905536:12345-192.168.202.36@tcp:35:umount.0 00000100:00100000:2.0:1787134801.308685:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa515fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486fb1ad-4266-4864-b299-111c5140734b+21:12346:x1873946287905536:12345-192.168.202.36@tcp:35:umount.0 Request processed in 937us (1601us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787134801.308696:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:0.0:1787134801.331675:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134801.331964:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287905792 00000100:00100000:2.0:1787134801.331977:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287905792 00000100:00100000:2.0:1787134801.332043:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:2.0:1787134801.332056:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+21:12346:x1873946287905792:12345-192.168.202.36@tcp:35:umount.0 00000100:00100000:2.0:1787134801.332676:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486fb1ad-4266-4864-b299-111c5140734b+22:12346:x1873946287905792:12345-192.168.202.36@tcp:35:umount.0 Request processed in 621us (1015us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787134801.332703:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:1.0:1787134801.339209:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134801.339249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134801.339387:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134801.339974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134801.340003:0:7839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287906176 00000100:00100000:1.0:1787134801.340013:0:7839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287906176 00000100:00100000:1.0:1787134801.340064:0:7839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 73 00000100:00100000:1.0:1787134801.340073:0:7839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+7:2348:x1873946287906176:12345-192.168.202.36@tcp:9:umount.0 00000020:00000080:1.0:1787134801.340999:0:7839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae906373 00000020:00010000:1.0:1787134801.341014:0:7839:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98aa7f6b8000: total 0 00000100:00080000:1.0:1787134801.341020:0:7839:0:(import.c:65:import_set_state_nolock()) ffff98aa7f6bb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787134801.341069:0:7839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787134801.343837:0:7839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486fb1ad-4266-4864-b299-111c5140734b+5:2348:x1873946287906176:12345-192.168.202.36@tcp:9:umount.0 Request processed in 3752us (3852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134801.343851:0:7839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 73 00000020:00010000:1.0:1787134801.343883:0:5824:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98aa7f6b8000: total 0 00010000:00010000:1.0:1787134801.343910:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98aa7f6b8000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787134801.343965:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058210eb8/0x69932dacae90670f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070493 expref: 4 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134801.344003:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066ac3d33/0x69932dacae906dad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070661 expref: 3 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134801.344016:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98aa7f6b8000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787134801.344026:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134801.344028:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134801.344030:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134801.348723:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287906304 00000100:00100000:3.0:1787134801.348741:0:7620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287906304 00000100:00100000:3.0:1787134801.348866:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287906560 00000100:00100000:3.0:1787134801.348870:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287906560 00000100:00100000:3.0:1787134801.348890:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287906432 00000100:00100000:3.0:1787134801.348893:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287906432 00000100:00100000:3.0:1787134801.348916:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:3.0:1787134801.348926:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+15:2350:x1873946287906304:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134801.348962:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134801.348985:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7ba00/0x69932dacae905e33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701f3 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.349004:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134801.349079:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+14:2350:x1873946287906304:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 153us (9888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134801.349087:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:3.0:1787134801.349119:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:3.0:1787134801.349126:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+13:2350:x1873946287906560:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134801.349134:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134801.349144:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea400/0x69932dacae90601d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702be expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.349152:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134801.349194:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:2350:x1873946287906560:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 68us (9945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134801.349201:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:3.0:1787134801.349213:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:3.0:1787134801.349218:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:2350:x1873946287906432:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134801.349225:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134801.349233:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa41671400/0x69932dacae905d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701bb expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.349242:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134801.349257:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2350:x1873946287906432:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 39us (9871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134801.349288:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00010000:00010000:3.0:1787134801.356760:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134801.358717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134801.358791:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287907584 00000100:00100000:1.0:1787134801.358804:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287907584 00000100:00100000:1.0:1787134801.358875:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 240 00000100:00100000:1.0:1787134801.358887:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+22:2348:x1873946287907584:12345-192.168.202.36@tcp:39:umount.0 00000020:00000080:1.0:1787134801.358919:0:5836:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905da7 00000020:00010000:1.0:1787134801.358938:0:5836:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98aa6fab9000: total 0 00000100:00080000:1.0:1787134801.358943:0:5836:0:(import.c:65:import_set_state_nolock()) ffff98aa55101000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787134801.358979:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1787134801.359935:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486fb1ad-4266-4864-b299-111c5140734b+21:2348:x1873946287907584:12345-192.168.202.36@tcp:39:umount.0 Request processed in 1046us (1223us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787134801.359947:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 240 00000020:00010000:3.0:1787134801.360944:0:5824:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98aa6fab9000: total 0 00010000:00010000:3.0:1787134801.360952:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134801.361003:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98aa6fab9000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787134801.361044:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:3.0:1787134801.361050:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787134801.361062:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7800/0x69932dacae906d6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907064c expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361082:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cc00) 00010000:00010000:3.0:1787134801.361084:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787134801.361088:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae906771 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704af expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361101:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa50ade600) 00010000:00010000:3.0:1787134801.361104:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134801.361107:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa59dea600/0x69932dacae90608d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702d3 expref: 18 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361125:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:3.0:1787134801.361127:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787134801.361131:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450200/0x69932dacae9066d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907047e expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361145:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:3.0:1787134801.361147:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787134801.361546:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451c00/0x69932dacae9066fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907048c expref: 16 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361566:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:3.0:1787134801.361569:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787134801.361573:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae906d98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907065a expref: 15 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361598:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:3.0:1787134801.361600:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787134801.361604:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae9063ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90703ba expref: 14 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361615:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98aa44db2c00) 00010000:00010000:3.0:1787134801.361618:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787134801.361622:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450800/0x69932dacae906071 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702cc expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361637:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:3.0:1787134801.361639:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787134801.361643:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97600/0x69932dacae90678d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90704b6 expref: 12 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361655:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:3.0:1787134801.361657:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787134801.361661:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae906a6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070588 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361675:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98aa42a7ca00) 00010000:00010000:3.0:1787134801.361686:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787134801.361691:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96800/0x69932dacae906c8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070614 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361709:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98aa59e99d00) 00010000:00010000:3.0:1787134801.361711:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787134801.361715:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451800/0x69932dacae9065f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070446 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361730:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98aa42a7cd00) 00010000:00010000:3.0:1787134801.361732:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787134801.361735:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ac00/0x69932dacae9060e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702e8 expref: 8 pid: 11472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134801.361747:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98aa6fab9000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787134801.361763:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134801.361765:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134801.361768:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134802.368342:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134803.329194:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787134803.329218:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312008704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134803.329301:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134803.329922:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312008704 00000100:00100000:3.0:1787134803.329935:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312008704 00000100:00100000:3.0:1787134803.330006:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787134803.330016:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312008704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134803.330068:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134803.330135:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312008704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134803.330145:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787134803.330627:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134803.333639:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312008704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787134803.393289:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787134803.394096:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787134803.394104:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134803.394776:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787134803.394789:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:2.0:1787134803.399106:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:2.0:1787134803.399116:0:7632:0:(genops.c:906:class_export_put()) final put ffff98aa7f6b8000/486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:2.0:1787134803.399147:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7f6b8000/486fb1ad-4266-4864-b299-111c5140734b for lustre-OST0001 00000020:00000080:2.0:1787134803.399232:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa7f6bb800 for lustre-OST0001 00000001:00080000:3.0:1787134803.402783:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:3.0:1787134803.402952:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000001:00080000:3.0:1787134803.402960:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787134803.402972:0:5858:0:(genops.c:906:class_export_put()) final put ffff98aa6fab9000/486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:2.0:1787134803.403033:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6fab9000/486fb1ad-4266-4864-b299-111c5140734b for lustre-MDT0000 00000020:00000080:2.0:1787134803.403104:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa55101000 for lustre-MDT0000 00000100:00100000:3.0:1787134803.923464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134803.923521:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134803.923563:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134803.923730:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287907712 00000100:00100000:2.0:1787134803.923742:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287907712 00000100:00100000:2.0:1787134803.923809:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287907968 00000100:00100000:2.0:1787134803.923813:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287907968 00000100:00100000:2.0:1787134803.923826:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287907840 00000100:00100000:2.0:1787134803.923829:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287907840 00000100:00100000:2.0:1787134803.923849:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:2.0:1787134803.923860:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+12:2349:x1873946287907712:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134803.923879:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134803.923906:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59debe00/0x69932dacae905e79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070208 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134803.923926:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134803.923993:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+11:2349:x1873946287907712:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 135us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134803.924000:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:2.0:1787134803.924032:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:2.0:1787134803.924037:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+10:2349:x1873946287907968:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134803.924044:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134803.924052:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa96200/0x69932dacae906016 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90702b7 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134803.924063:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134803.924083:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+9:2349:x1873946287907968:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 46us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134803.924089:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:2.0:1787134803.924101:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:2.0:1787134803.924108:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+8:2349:x1873946287907840:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134803.924115:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134803.924123:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa413fde00/0x69932dacae905e80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070232 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134803.924132:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134803.924148:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+7:2349:x1873946287907840:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 41us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134803.924154:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:0.0:1787134803.942228:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134803.945077:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287908224 00000100:00100000:1.0:1787134803.945930:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287908224 00000100:00080000:3.0:1787134803.946108:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134803.946203:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 241 00000100:00100000:1.0:1787134803.946215:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+6:2348:x1873946287908224:12345-192.168.202.36@tcp:39:umount.0 00000020:00000080:1.0:1787134803.946276:0:5837:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905e8e 00000020:00010000:1.0:1787134803.946285:0:5837:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98aa6fabf000: total 0 00000100:00080000:1.0:1787134803.946291:0:5837:0:(import.c:65:import_set_state_nolock()) ffff98aa6faba800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787134803.946330:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1787134803.946802:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:602cf179-3fa4-4e4c-92db-c355fb291830+5:2348:x1873946287908224:12345-192.168.202.36@tcp:39:umount.0 Request processed in 587us (4582us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787134803.946811:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 241 00000020:00010000:3.0:1787134803.947222:0:5823:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98aa6fabf000: total 0 00010000:00010000:3.0:1787134803.947277:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98aa6fabf000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787134803.947312:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa42a7cc00) 00010000:00010000:3.0:1787134803.947327:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787134803.947337:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae906dbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070668 expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134803.947366:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98aa6fabf000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787134803.947394:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134803.947397:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134803.947399:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134803.974796:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134803.975248:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287908480 00000100:00100000:1.0:1787134803.975262:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287908480 00000100:00100000:1.0:1787134803.975339:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 313 00000100:00100000:1.0:1787134803.975352:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+7:2348:x1873946287908480:12345-192.168.202.36@tcp:251:umount.0 00000020:00000080:1.0:1787134803.975417:0:5830:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905d84 00000020:00010000:1.0:1787134803.975428:0:5830:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98aa55105000: total 0 00000100:00080000:1.0:1787134803.975433:0:5830:0:(import.c:65:import_set_state_nolock()) ffff98aa55100800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787134803.975740:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85dd26fe-3b2f-4906-a4d5-14f2ec42de7d+3:2348:x1873946287908480:12345-192.168.202.36@tcp:251:umount.0 Request processed in 388us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134803.975750:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 313 00000020:00010000:0.0:1787134803.976468:0:5824:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98aa55105000: total 0 00010000:00010000:0.0:1787134803.976489:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134803.976542:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98aa55105000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787134803.976659:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa413fd800/0x69932dacae905e3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90701fa expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134803.976679:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98aa55105000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787134803.976691:0:5824:0:(genops.c:906:class_export_put()) final put ffff98aa55105000/85dd26fe-3b2f-4906-a4d5-14f2ec42de7d 00010000:00010000:0.0:1787134803.976713:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134803.976715:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134803.976717:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787134803.976765:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa55105000/85dd26fe-3b2f-4906-a4d5-14f2ec42de7d for MGS 00000020:00000080:2.0:1787134803.976810:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa55100800 for MGS 00010000:00010000:3.0:1787134804.417528:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134804.881948:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134804.881973:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312008832:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882048:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134804.882120:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312008832 00000100:00100000:0.0:1787134804.882129:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312008832 00000100:00100000:0.0:1787134804.882208:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787134804.882219:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946312008832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882289:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa43378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3310:x1873946312008832:12345-0@lo:400:kworker.0 Request processed in 72us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134804.882297:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787134804.882382:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312008832:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882424:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312008960:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882452:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134804.882482:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312008960 00000100:00100000:0.0:1787134804.882486:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312008960 00000100:00100000:0.0:1787134804.882517:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787134804.882523:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312008960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882580:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312008960:12345-0@lo:400:kworker.0 Request processed in 57us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134804.882587:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787134804.882617:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312008960:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882653:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312009088:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134804.882708:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312009088 00000100:00100000:0.0:1787134804.882713:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312009088 00000100:00100000:0.0:1787134804.882744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787134804.882751:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312009088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882800:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312009088:12345-0@lo:400:kworker.0 Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134804.882807:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1787134804.882822:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134804.882844:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312009088:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882875:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312009216:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882905:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134804.882935:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312009216 00000100:00100000:0.0:1787134804.882939:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312009216 00000100:00100000:0.0:1787134804.882961:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787134804.882967:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312009216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.882998:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312009216:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134804.883005:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787134804.883027:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312009216:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.883060:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134804.883065:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312009344:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.883086:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134804.883108:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312009344 00000100:00100000:0.0:1787134804.883111:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312009344 00000100:00100000:0.0:1787134804.883136:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787134804.883142:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312009344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.883238:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312009344:12345-0@lo:400:kworker.0 Request processed in 96us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134804.883245:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1787134804.883258:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134804.883278:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312009344:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.883306:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312009472:0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.883330:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134804.883356:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312009472 00000100:00100000:0.0:1787134804.883373:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312009472 00000100:00100000:0.0:1787134804.883402:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787134804.883407:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312009472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134804.883440:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312009472:12345-0@lo:400:kworker.0 Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134804.883446:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1787134804.883458:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134804.883475:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312009472:0@lo:400:kworker.0 00000001:00100000:1.0:1787134805.006631:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:1.0:1787134805.006642:0:6707:0:(genops.c:906:class_export_put()) final put ffff98aa7ae03000/486fb1ad-4266-4864-b299-111c5140734b 00000020:00000080:2.0:1787134805.006717:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7ae03000/486fb1ad-4266-4864-b299-111c5140734b for lustre-OST0000 00000020:00000080:2.0:1787134805.006769:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa7ae05800 for lustre-OST0000 00000100:00100000:0.0:1787134805.384512:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787134805.384856:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312009600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134805.393696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134805.404336:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312009600 00000100:00100000:1.0:1787134805.404353:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312009600 00000100:00100000:1.0:1787134805.404424:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787134805.404436:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312009600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134805.404478:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134805.404694:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312009600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 260us (11003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134805.404702:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787134805.407795:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312009600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787134805.441812:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787134805.986848:0:13065:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787134806.005838:0:13065:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787134806.005912:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.005928:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.005936:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.005942:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.005966:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787134806.005973:0:13065:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787134806.006009:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787134806.006014:0:13065:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787134806.006020:0:13065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787134806.006098:0:13065:0:(import.c:65:import_set_state_nolock()) ffff98aa7bc5d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787134806.006191:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946312009728:0@lo:39:umount.0 00000100:00100000:0.0:1787134806.006286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787134806.007694:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134806.007709:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134806.007731:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa41670a00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134806.007736:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134806.007746:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134806.007772:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134806.007777:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787134806.007780:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787134806.007783:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787134806.007823:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134806.007829:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134806.007864:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134806.007872:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa41670a00/0x69932dacae905e09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905e10 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134806.007888:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134806.007890:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134806.007892:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134806.007900:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134806.007922:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946312009856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134806.007989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134806.008049:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312009856 00000100:00100000:3.0:1787134806.008056:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312009856 00000100:00100000:3.0:1787134806.008106:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787134806.008115:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946312009856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134806.008127:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134806.008142:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea200/0x69932dacae905e10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905e09 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134806.008185:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134806.008226:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+18:3307:x1873946312009856:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134806.008233:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787134806.008466:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946312009856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787134806.010400:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312009728 00000100:00100000:1.0:1787134806.010417:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312009728 00000100:00100000:1.0:1787134806.010840:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787134806.010853:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873946312009728:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787134806.010886:0:5835:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905b93 00000100:00080000:1.0:1787134806.010895:0:5835:0:(import.c:65:import_set_state_nolock()) ffff98aa6ff97000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787134806.012477:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134806.017192:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1873946312009728:12345-0@lo:39:umount.0 Request processed in 6331us (10895us total) trans 0 rc 0/0 00000100:00080000:0.0:1787134806.017195:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa7bc5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787134806.017208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787134806.017210:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946312009728:0@lo:39:umount.0 00000020:00000080:1.0:1787134806.017226:0:5835:0:(genops.c:906:class_export_put()) final put ffff98aa6ff93000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1787134806.017295:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787134806.017301:0:13065:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787134806.017306:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787134806.018443:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018461:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018468:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018476:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018498:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134806.018504:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018510:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018516:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018521:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018549:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787134806.018557:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018563:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018570:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018576:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018583:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787134806.018587:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018594:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018601:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018607:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.018614:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787134806.018617:0:13065:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787134806.018646:0:13065:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787134806.018650:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787134806.018655:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787134806.018660:0:13065:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1787134806.018667:0:13065:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98aa551b2800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787134806.018673:0:13065:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98aa7408b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787134806.018679:0:13065:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff98aa6fabf000 602cf179-3fa4-4e4c-92db-c355fb291830 192.168.202.36@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787134806.018684:0:13065:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff98aa6ff88000) has exports, disconnecting them 00000020:00080000:2.0:1787134806.018688:0:13065:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98aa551b2800), last request at 1787134804 00000020:00000080:2.0:1787134806.018695:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905d06 00000100:00080000:2.0:1787134806.018710:0:13065:0:(import.c:65:import_set_state_nolock()) ffff98aa551b3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787134806.018752:0:13065:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98aa551b2800): rc 0 00000020:00000080:2.0:1787134806.018754:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa551b2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787134806.018759:0:13065:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98aa7408b800), last request at 1787134804 00000020:00000080:2.0:1787134806.018763:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905c3b 00000100:00080000:2.0:1787134806.018767:0:13065:0:(import.c:65:import_set_state_nolock()) ffff98aa74089000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787134806.018774:0:13065:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98aa7408b800): rc 0 00000020:00000080:2.0:1787134806.018775:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa7408b800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787134806.018782:0:13065:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbeb4c16d7ae0 00010000:00010000:1.0:1787134806.018808:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787134806.018818:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.018827:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b000 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134806.018830:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.018840:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134806.018848:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134806.018853:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787134806.018856:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1787134806.018858:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1787134806.018895:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.018902:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787134806.018926:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.018932:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7b000/0x69932dacae905e17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905e1e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.018945:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787134806.018948:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.018954:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa40030c00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134806.018963:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.018971:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134806.018978:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134806.018983:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787134806.018985:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787134806.018987:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787134806.019001:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019007:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787134806.019014:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019020:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa40030c00/0x69932dacae905d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905d45 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019034:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787134806.019037:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019043:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deae00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134806.019047:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019054:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134806.019068:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134806.019073:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787134806.019075:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787134806.019077:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787134806.019092:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019098:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787134806.019114:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019121:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa59deae00/0x69932dacae906040 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae906047 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019130:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134806.019133:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019139:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa40031600 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134806.019142:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019149:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134806.019155:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134806.019187:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787134806.019190:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787134806.019192:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787134806.019205:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019211:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787134806.019217:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019224:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa40031600/0x69932dacae905af2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905af9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134806.019235:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134806.019237:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134806.019238:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134806.020041:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787134806.020181:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6ff93000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787134806.020242:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa551b2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787134806.020268:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7408b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787134806.020292:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa6ff97000 for lustre-MDT0000 00000020:00000080:3.0:1787134806.020297:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa551b3000 for lustre-MDT0000 00000020:00000080:3.0:1787134806.020380:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa74089000 for lustre-MDT0000 00000100:00100000:3.0:1787134806.020403:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946312010240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787134806.020408:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312009984:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787134806.020540:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787134806.020545:0:13065:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787134806.020562:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787134806.020640:0:13065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787134806.020662:0:13065:0:(import.c:65:import_set_state_nolock()) ffff98aa52a7c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787134806.020681:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787134806.020684:0:13065:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1787134806.020694:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787134806.020715:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312010496:0@lo:9:umount.0 00000100:00080000:2.0:1787134806.020759:0:13065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787134806.020780:0:13065:0:(import.c:65:import_set_state_nolock()) ffff98aa7f76a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787134806.020814:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98aa6ff88000) has no exports 00000100:00100000:3.0:1787134806.020893:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134806.021003:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312010240 00000100:00100000:2.0:1787134806.021011:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312010240 00000100:00100000:3.0:1787134806.021015:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134806.021024:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946312010368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134806.021050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134806.021062:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312010368 00000100:00100000:2.0:1787134806.021067:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312010368 00000100:00100000:3.0:1787134806.021115:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787134806.021126:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946312010240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134806.021140:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134806.021182:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59deb600/0x69932dacae906047 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae906040 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134806.021182:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787134806.021193:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+19:3307:x1873946312010368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134806.021201:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134806.021204:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134806.021216:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59deaa00/0x69932dacae905af9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905af2 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.021233:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134806.021244:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:3307:x1873946312010240:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134806.021266:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787134806.021271:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+17:3307:x1873946312010368:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134806.021279:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787134806.021325:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946312010368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134806.021334:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3307:1873946312010240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134806.023403:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312010112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134806.023473:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134806.023571:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312010112 00000100:00100000:2.0:1787134806.023577:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312010112 00000100:00100000:2.0:1787134806.023631:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787134806.023641:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+16:3310:x1873946312010112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134806.023654:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134806.023671:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7b600/0x69932dacae905d45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905d3e expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.023687:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134806.023731:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:3310:x1873946312010112:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134806.023747:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787134806.023792:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312010112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787134806.024150:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134806.024226:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312009984 00000100:00100000:2.0:1787134806.024231:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312009984 00000100:00100000:0.0:1787134806.024273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134806.024274:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787134806.024281:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942207480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+15:3309:x1873946312009984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134806.024301:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787134806.024307:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312010624:0@lo:9:umount.0 00010000:00010000:2.0:1787134806.024312:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa41670800/0x69932dacae905e1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905e17 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134806.024323:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134806.024335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134806.024344:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942207480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:3309:x1873946312009984:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134806.024362:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787134806.024366:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312010496 00000100:00100000:0.0:1787134806.024369:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312010496 00000100:00080000:2.0:1787134806.024397:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134806.024406:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312010624 00000100:00100000:0.0:1787134806.024409:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312010624 00000100:00100000:0.0:1787134806.024439:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787134806.024456:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873946312010496:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787134806.024495:0:6680:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905c88 00000100:00080000:0.0:1787134806.024504:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98aa7408c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787134806.024540:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787134806.024851:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3306:x1873946312010496:12345-0@lo:9:umount.0 Request processed in 405us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134806.024858:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787134806.024872:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787134806.024878:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873946312010624:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787134806.024902:0:6680:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905d6f 00000100:00080000:0.0:1787134806.024907:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98aa7f768800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787134806.024930:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787134806.025135:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3306:x1873946312010624:12345-0@lo:9:umount.0 Request processed in 255us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134806.025142:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1787134806.025194:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787134806.025215:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa7f76a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787134806.025226:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787134806.025228:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787134806.025231:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312010624:0@lo:9:umount.0 00000100:00080000:0.0:1787134806.025250:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa52a7c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787134806.025260:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787134806.025262:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787134806.025264:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312010496:0@lo:9:umount.0 00000100:00100000:1.0:1787134806.025594:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3309:1873946312009984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787134806.025637:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787134806.025735:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1787134806.038681:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98aa6ff88000) has no exports 00000020:00000080:3.0:1787134806.108509:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905b4d 00000020:00000080:3.0:1787134806.108526:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa81567000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787134806.108545:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787134806.110223:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787134806.110239:0:13065:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787134806.110244:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff98aa438f4d40) has no exports 00000020:00000080:2.0:1787134806.110617:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905b46 00000020:00000080:2.0:1787134806.110626:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa7bc56800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787134806.110691:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787134806.110700:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787134806.111109:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa81567000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787134806.111115:0:475:0:(genops.c:906:class_export_put()) final put ffff98aa7bc55000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787134806.111118:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7bc55000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787134806.111126:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787134806.111287:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7bc56800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787134806.465046:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134807.488797:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134808.518462:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787134808.538194:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787134808.538203:0:7632:0:(genops.c:906:class_export_put()) final put ffff98aa7f76c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787134808.538244:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7f76c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787134808.538309:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa7f768800 for lustre-OST0001 00000001:00100000:0.0:1787134808.566989:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 602cf179-3fa4-4e4c-92db-c355fb291830 00000001:00080000:0.0:1787134808.567004:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787134808.567011:0:5858:0:(genops.c:906:class_export_put()) final put ffff98aa6fabf000/602cf179-3fa4-4e4c-92db-c355fb291830 00000020:00000080:0.0:1787134808.567034:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6fabf000/602cf179-3fa4-4e4c-92db-c355fb291830 for lustre-MDT0000 00000020:00000080:0.0:1787134808.567088:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa6faba800 for lustre-MDT0000 00010000:00010000:1.0:1787134809.536594:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134809.984602:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787134809.984628:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946312011008:0@lo:400:kworker.0 00000100:00100000:2.0:1787134809.984724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134809.984917:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312010880:0@lo:400:kworker.0 00000100:00100000:0.0:1787134809.984949:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134809.984988:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134809.984995:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312010752:0@lo:400:kworker.0 00000100:00100000:0.0:1787134809.985027:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134809.985062:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312011008 00000100:00100000:0.0:1787134809.985070:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312011008 00000100:00100000:0.0:1787134809.985106:0:11472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312010880 00000100:00100000:0.0:1787134809.985109:0:11472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312010880 00000100:00100000:0.0:1787134809.985125:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787134809.985132:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1873946312011008:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787134809.985140:0:11472:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787134809.985203:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1873946312011008:12345-0@lo:400:kworker.0 Request processed in 69us (479us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787134809.985211:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787134809.985227:0:11472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787134809.985231:0:11472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1873946312010880:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787134809.985236:0:11472:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:1.0:1787134809.985534:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787134809.985541:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98aa6f898800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787134809.985545:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787134809.986442:0:11472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1873946312010880:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787134809.986452:0:11472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1787134809.986498:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787134809.986502:0:3310:0:(import.c:65:import_set_state_nolock()) ffff98aa7faa8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787134809.986506:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787134809.986511:0:3310:0:(import.c:65:import_set_state_nolock()) ffff98aa7faa8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787134809.986516:0:3310:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 179 00000100:00080000:0.0:1787134809.986522:0:3310:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98aa7faa8800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787134809.986556:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa819e5180 x1873946312011136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787134809.986603:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312010880:0@lo:400:kworker.0 00000100:00100000:0.0:1787134809.986634:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1873946312011136:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787134809.986680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134809.986907:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312011136 00000100:00100000:2.0:1787134809.986914:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312011136 00000100:00100000:2.0:1787134809.986947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787134809.986954:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1873946312011136:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787134809.986972:0:5837:0:(ldlm_lib.c:1208:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787134809.987044:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312010752 00000100:00100000:0.0:1787134809.987049:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312010752 00000100:00100000:0.0:1787134809.987079:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787134809.987085:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:3310:x1873946312010752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134809.987136:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa4337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5b817d2-f0c2-441a-949c-994c1ff95f2c+14:3310:x1873946312010752:12345-0@lo:400:kworker.0 Request processed in 50us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134809.987142:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787134809.987204:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312010752:0@lo:400:kworker.0 00000100:00080000:1.0:1787134809.997750:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98aa6f898800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787134809.997761:0:3308:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 198 00000100:00080000:1.0:1787134809.997789:0:3308:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98aa6f898800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787134809.998022:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a942205500 x1873946312011264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787134809.998052:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946312011008:0@lo:400:kworker.0 00000100:00100000:1.0:1787134809.998098:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1873946312011264:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787134810.005621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134810.005719:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312011264 00000100:00100000:1.0:1787134810.005728:0:11683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312011264 00000100:00100000:1.0:1787134810.005772:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787134810.005780:0:11683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3306:x1873946312011264:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1787134810.005800:0:11683:0:(ldlm_lib.c:1208:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787134810.005859:0:11683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3306:x1873946312011264:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 79us (245us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787134810.005867:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787134810.005922:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa6f898800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787134810.005928:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787134810.005933:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1873946312011264:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787134810.027829:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1873946312011136:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 40865us (41140us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787134810.027845:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1787134810.027905:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa7faa8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787134810.027911:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787134810.028294:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1873946312011136:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:1.0:1787134810.090730:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787134810.090740:0:6707:0:(genops.c:906:class_export_put()) final put ffff98aa7408a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787134810.090780:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7408a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787134810.090826:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa7408c800 for lustre-OST0000 00010000:00010000:3.0:1787134810.562001:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134811.584467:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787134812.165055:0:13065:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98aa81f0fe40 - data ffff98aa422971b0/ffff98aa741bd800 00000020:01000000:0.0:1787134812.165796:0:13065:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98aa58c935a0 - data ffff98aa6b71daf8/ffff98aa7573dc00 00000001:00000004:0.0:1787134812.175553:0:13065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787134812.273630:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787134812.273640:0:13065:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787134812.273667:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787134812.273670:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787134812.274418:0:6866:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787134812.274423:0:6866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787134812.274433:0:6866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787134812.275744:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787134812.275751:0:13065:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787134812.275771:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787134812.275774:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787134812.276026:0:7837:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787134812.276030:0:7837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787134812.276038:0:7837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787134812.343043:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905b15 00000020:00000080:1.0:1787134812.343053:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa6ff91800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787134812.343409:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6ff91800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787134812.344732:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905b2a 00000020:00000080:1.0:1787134812.344739:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa6ff94800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787134812.344794:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787134812.344799:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787134812.344807:0:13065:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787134812.344810:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98aa6ff8b380) has no exports 00000004:01000000:1.0:1787134812.344929:0:13065:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787134812.344935:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905d68 00000020:00000080:1.0:1787134812.344938:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa6f89e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787134812.347759:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6ff94800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787134812.348591:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787134812.348603:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787134812.348616:0:13065:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787134812.348621:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff98aa81478000) has no exports 00000020:00000080:1.0:1787134812.348631:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905d61 00000020:00000080:1.0:1787134812.348639:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa73ca9800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787134812.348927:0:13065:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787134812.348931:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787134812.348935:0:13065:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787134812.348939:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787134812.348940:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787134812.348966:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787134812.348971:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787134812.348975:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905c81 00000020:00000080:1.0:1787134812.348977:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa52a7f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787134812.348980:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787134812.348982:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787134812.348985:0:13065:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787134812.348986:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98aa6aa4cd40) has no exports 00000020:00000080:1.0:1787134812.348989:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905c7a 00000020:00000080:1.0:1787134812.348991:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa764ce000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787134812.349627:0:13065:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787134812.349631:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787134812.349634:0:13065:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787134812.349639:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787134812.349651:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787134812.349676:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787134812.349680:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787134812.349706:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787134812.349708:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787134812.349711:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa6aa83000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787134812.349713:0:13065:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6aa83000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787134812.349718:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787134812.349856:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905b31 00000020:00000080:1.0:1787134812.349859:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa6ff92000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787134812.349862:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787134812.349864:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787134812.349867:0:13065:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787134812.349869:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff98aa6ff8cd40) has no exports 00000020:00000080:1.0:1787134812.349883:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787134812.349884:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787134812.349887:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905b38 00000020:00000080:1.0:1787134812.349889:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa6ff94000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787134812.349894:0:13065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98aa4da38000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787134812.349897:0:13065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa4da38000 3 00000020:01000004:1.0:1787134812.349899:0:13065:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98aa4da38000 from lustre-MDT0000 00000020:00000080:1.0:1787134812.349915:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787134812.349917:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787134812.349919:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa6ff95000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787134812.349920:0:13065:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6ff95000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787134812.349926:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787134812.349942:0:13065:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787134812.349945:0:13065:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787134812.349947:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787134812.349948:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787134812.349950:0:13065:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787134812.349954:0:13065:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98aa52a89800 e5b817d2-f0c2-441a-949c-994c1ff95f2c 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787134812.349958:0:13065:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff98aa438f0000) has exports, disconnecting them 00000020:00080000:1.0:1787134812.349965:0:13065:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98aa52a89800), last request at 1787134545 00000020:00000080:1.0:1787134812.349975:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905acf 00000020:00010000:1.0:1787134812.349978:0:13065:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98aa52a89800: total 6 00000100:00080000:1.0:1787134812.349980:0:13065:0:(import.c:65:import_set_state_nolock()) ffff98aa52a88000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787134812.350070:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6f89e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787134812.350076:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa73ca9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787134812.350080:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa7f76a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787134812.350084:0:475:0:(genops.c:906:class_export_put()) final put ffff98aa551b5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787134812.350085:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa551b5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787134812.350087:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787134812.350128:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa52a7f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787134812.350131:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa764ce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787134812.350133:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa52a7c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787134812.350136:0:475:0:(genops.c:906:class_export_put()) final put ffff98aa7f78b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787134812.350137:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7f78b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787134812.350140:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787134812.350202:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6ff92000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787134812.350206:0:475:0:(genops.c:906:class_export_put()) final put ffff98aa6ff96800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787134812.350207:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6ff96800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787134812.350214:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787134812.350433:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6ff94000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1787134812.351202:0:13065:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98aa52a89800): rc 0 00000020:00080000:1.0:1787134812.351208:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff98aa438f0000) has no exports 00000100:00100000:1.0:1787134812.351349:0:5828:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff98aa492f4600:5828] 0 exiting: rc = 1 00000100:00100000:3.0:1787134812.352741:0:5830:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff98aa47280200:5830] 2 exiting: rc = 0 00000100:00100000:1.0:1787134812.353520:0:5829:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff98aa42dc0200:5829] 1 exiting: rc = 0 00000100:00100000:3.0:1787134812.353668:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353674:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353678:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353683:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353687:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353691:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353695:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353698:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353702:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353705:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353709:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353714:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353719:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353723:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353727:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353731:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353735:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353739:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353742:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353760:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353764:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353767:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353772:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353775:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353780:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353784:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353787:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353791:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353795:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353798:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353802:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353806:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353809:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353812:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353816:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353819:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353822:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353825:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353829:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353832:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353836:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353840:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353843:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353847:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353850:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353854:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353858:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353861:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353864:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353868:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353872:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353875:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353879:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353883:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353891:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353894:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353898:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353902:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353908:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353914:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353919:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353925:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353930:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134812.353936:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787134812.354591:0:13065:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787134812.354596:0:13065:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:0.0:1787134812.355772:0:5824:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98aa52a89800: total 0 00010000:00010000:0.0:1787134812.355821:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98aa52a89800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787134812.355850:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa413fc800/0x69932dacae905e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905dfb expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134812.355870:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7b200/0x69932dacae906039 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae906032 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134812.355890:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59deb200/0x69932dacae905bee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905be7 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134812.355904:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7a000/0x69932dacae905e2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905e25 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134812.355914:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa97a00/0x69932dacae90602b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae906024 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134812.355927:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7a600/0x69932dacae905dd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905dd1 expref: 4 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134812.355936:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7a800/0x69932dacae905df4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905ded expref: 3 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134812.355946:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae905de6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x69932dacae905ddf expref: 2 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134812.355956:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98aa52a89800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787134812.355966:0:5824:0:(genops.c:906:class_export_put()) final put ffff98aa52a89800/e5b817d2-f0c2-441a-949c-994c1ff95f2c 00000020:00000080:0.0:1787134812.355987:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa52a89800/e5b817d2-f0c2-441a-949c-994c1ff95f2c for MGS 00000020:00000080:0.0:1787134812.356017:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa52a88000 for MGS 00010000:00010000:0.0:1787134812.356026:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134812.356028:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134812.356030:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787134812.356615:0:13065:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98aa81f0f960 - data ffff98aa7fffcbd0/ffff98aa741bd000 00000020:01000000:3.0:1787134812.356736:0:13065:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98aa4346d4e0 - data ffff98aa6b0385e8/ffff98aa52a01c00 00000020:00000080:3.0:1787134812.357453:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905aba 00000020:00000080:3.0:1787134812.357460:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa47bda000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787134812.357476:0:13065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98aa4da38000 from MGS, refs=2 00000020:01000004:3.0:1787134812.357479:0:13065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa4da38000 2 00000020:01000004:3.0:1787134812.357482:0:13065:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98aa4da38000 from MGS 00000020:00000080:0.0:1787134812.357580:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa47bda000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787134812.357626:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787134812.357633:0:13065:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787134812.357636:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa47bdb800/MGS 00000020:00000080:3.0:1787134812.357638:0:13065:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa47bdb800/MGS for MGS 00000020:01000000:3.0:1787134812.357644:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787134812.357694:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787134812.357698:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787134812.357703:0:13065:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787134812.357709:0:13065:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98aa7bc5a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787134812.357714:0:13065:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff98aa438f19c0) has exports, disconnecting them 00000020:00080000:3.0:1787134812.357718:0:13065:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98aa7bc5a800), last request at 1787134546 00000020:00000080:3.0:1787134812.357722:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905b85 00000020:00080000:3.0:1787134812.357732:0:13065:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98aa7bc5a800): rc 0 00000020:00000080:3.0:1787134812.357748:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa7bc5a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787134812.358627:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7bc5a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787134812.365622:0:13065:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787134812.365632:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787134812.365646:0:13065:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787134812.365653:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787134812.365815:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787134812.365825:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787134812.365834:0:13065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa4da38000 1 00000020:00000080:0.0:1787134812.365841:0:13065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905aac 00000020:00000080:0.0:1787134812.365849:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa47bdd800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787134812.365855:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787134812.365860:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787134812.365864:0:13065:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787134812.365868:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff98aa438f3380) has no exports 00000020:00000080:1.0:1787134812.367010:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa7bc5d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787134812.367021:0:8:0:(genops.c:906:class_export_put()) final put ffff98aa7bc58000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787134812.367024:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7bc58000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787134812.367030:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787134812.367088:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa47bdd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787134812.444519:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787134812.444535:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787134812.444540:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa45733000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787134812.444546:0:13065:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa45733000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787134812.444556:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787134812.444692:0:13065:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98aa4da3d800 00000020:01000000:0.0:1787134812.444713:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787134812.444717:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787134812.444722:0:13065:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787134812.444726:0:13065:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98aa6aa48000) has no exports 00000100:00100000:0.0:1787134812.444800:0:5836:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff98aa438d3a00:5836] 1 exiting: rc = 0 00000100:00100000:0.0:1787134812.444899:0:5835:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff98aa438d2200:5835] 0 exiting: rc = 1 00000100:00100000:1.0:1787134812.446975:0:11683:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff98aa6aab3c00:11683] 4 exiting: rc = 0 00000100:00100000:1.0:1787134812.447084:0:11472:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff98aa6fd43e00:11472] 3 exiting: rc = 0 00000100:00100000:0.0:1787134812.495418:0:5837:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff98aa58c90e00:5837] 2 exiting: rc = 0 00000100:00100000:1.0:1787134812.495653:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495663:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495669:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495676:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495682:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495688:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495694:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495700:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495706:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495713:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.495718:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496048:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496068:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496075:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496080:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496087:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496108:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496114:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496120:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496127:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496133:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496139:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496145:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496151:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496184:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496191:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496197:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496203:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496209:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496214:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496230:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496236:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496258:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496264:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496270:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496277:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496283:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496299:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496307:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496313:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496319:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496325:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496331:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496338:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496344:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496350:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496357:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496364:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496370:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496376:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496382:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496395:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496401:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496408:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496414:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496419:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496426:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496432:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496438:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496444:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496450:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496456:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496462:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.496469:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.515077:0:12060:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff98aa4120a600:12060] 2 exiting: rc = 0 00000100:00100000:0.0:1787134812.516473:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98aa50e69a00:5839] 1 exiting: rc = 0 00000100:00100000:2.0:1787134812.519721:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98aa58c90c00:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1787134812.520083:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520093:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520099:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520105:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520110:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520115:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520122:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520128:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520134:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520140:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520148:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520154:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520183:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520188:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520194:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520199:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520204:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520209:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520214:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520220:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520225:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520259:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520265:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520270:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520275:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520280:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520285:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520297:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520302:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520306:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520311:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520315:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520319:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520323:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520328:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520333:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520337:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520342:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520347:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520352:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520357:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520362:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520367:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520372:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520377:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520382:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520387:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520391:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520396:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520400:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520405:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520411:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520417:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520422:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520428:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520433:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520445:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520462:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520467:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520473:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520477:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520482:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520716:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.520726:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.521225:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff98aa50e68200:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1787134812.521887:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff98aa50e69000:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1787134812.522091:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522099:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522108:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522115:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522121:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522126:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522134:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522141:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522147:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522153:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522190:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522196:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522201:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522208:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522230:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522239:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522466:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522472:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522478:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522484:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522584:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522592:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522598:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522604:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522610:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522615:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522654:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522660:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522666:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522673:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522678:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522684:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522689:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522694:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522700:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522706:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522711:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522717:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522734:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522741:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522747:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522752:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522762:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522769:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522776:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522784:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522790:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522796:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522802:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522807:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522825:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522831:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522837:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522842:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522850:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522855:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522861:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522867:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522873:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522879:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522885:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522896:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522913:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.522920:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.548429:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98aa55266c00:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1787134812.548665:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98aa55267e00:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1787134812.549751:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549759:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549774:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549780:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549786:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549792:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549798:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549803:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549808:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549813:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549818:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549824:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549830:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549835:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549840:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549845:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549849:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549855:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549859:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549864:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549868:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549873:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549878:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549883:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549888:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549894:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549899:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549903:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549908:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549914:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549919:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549941:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549946:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549951:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549957:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549962:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549967:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549972:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549977:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549981:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549986:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549991:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.549996:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550002:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550007:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550012:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550018:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550023:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550028:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550033:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550037:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550042:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550047:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550052:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550072:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550078:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550083:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550088:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550095:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550100:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550105:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550111:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550116:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.550122:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.566384:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98aa50e45600:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1787134812.566636:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98aa50e44600:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1787134812.566917:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566923:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566938:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566944:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566950:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566954:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566959:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566963:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566968:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566972:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566976:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566980:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566985:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566989:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566993:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.566998:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567003:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567007:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567012:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567016:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567021:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567025:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567030:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567035:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567040:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567044:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567050:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567064:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567070:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567074:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567079:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567084:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567088:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567093:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567098:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567103:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567107:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567120:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567125:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567130:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567135:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567139:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567143:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567148:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567153:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567179:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567185:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567191:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567196:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567202:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567207:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567212:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567217:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567222:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567226:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567231:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567236:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567241:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567246:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567266:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567271:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567277:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567282:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134812.567287:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.568081:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff98aa47bc9000:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1787134812.570772:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff98aa50e44800:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787134812.573663:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573673:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573699:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573704:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573710:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573715:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573721:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573726:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573732:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573737:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573742:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573749:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573755:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573761:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573766:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573772:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573778:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573784:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573790:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573795:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573801:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573807:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573813:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573818:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573823:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573829:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573835:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573840:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573846:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573851:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573856:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573862:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573868:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573873:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573878:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573883:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573889:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573901:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573907:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573913:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573918:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573923:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573928:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573933:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573938:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573944:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573950:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573956:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573962:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573967:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573972:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573977:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573983:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573988:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573994:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.573999:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.574004:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.574009:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.574015:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.574020:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.574025:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.574031:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.574035:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.574041:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.574556:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff98aa55266400:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1787134812.574741:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff98aa55246600:5850] 2 exiting: rc = 0 00000100:00100000:1.0:1787134812.575092:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff98aa55266000:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1787134812.575557:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575566:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575572:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575577:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575582:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575587:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575606:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575611:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575616:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575621:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575627:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575632:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575638:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575643:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575649:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575655:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575661:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575679:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575688:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575695:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575702:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575709:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575715:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575721:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575727:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575733:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575738:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575744:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575748:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575753:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575759:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575764:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575769:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575775:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575780:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575786:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575791:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575796:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575801:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575806:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575812:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575840:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575849:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575853:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575859:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575864:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575869:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575875:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575881:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575887:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575892:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575897:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575902:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575912:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575917:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575923:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575928:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575933:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575940:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575945:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575950:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575955:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575959:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134812.575964:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787134812.597964:0:13065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787134812.597987:0:13065:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787134812.597994:0:13065:0:(genops.c:906:class_export_put()) final put ffff98aa6aa81000/MDS_uuid 00000020:00000080:0.0:1787134812.598000:0:13065:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6aa81000/MDS_uuid for MDS 00000020:01000000:0.0:1787134812.598006:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787134812.599457:0:13065:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787134813.114788:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134814.145857:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134815.112680:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946312011392:0@lo:400:kworker.0 00000400:00000100:0.0:1787134815.112741:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873946312011392 offset 0 length 224: 4 00000100:00080000:3.0:1787134815.112806:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787134815.112811:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787134815.112815:0:475:0:(import.c:65:import_set_state_nolock()) ffff98aa7faa8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787134815.112821:0:475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 425 00000100:00080000:3.0:1787134815.112827:0:475:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787134815.112835:0:475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98aa7faa8800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787134815.112861:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa7f66f800 x1873946312011520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787134815.112878:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787134815.112881:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787134815.112883:0:475:0:(import.c:65:import_set_state_nolock()) ffff98aa6f898800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787134815.112886:0:475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 425 00000100:00080000:3.0:1787134815.112889:0:475:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787134815.112892:0:475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98aa6f898800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787134815.112903:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa7f66ca80 x1873946312011648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787134815.123740:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1873946312011520:0@lo:38:kworker.0 00000400:00000100:3.0:1787134815.123811:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873946312011520 offset 0 length 520: 4 00000100:00100000:3.0:1787134815.123844:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1873946312011648:0@lo:38:kworker.0 00000400:00000100:3.0:1787134815.123863:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873946312011648 offset 0 length 520: 4 00010000:00010000:2.0:1787134815.172739:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787134816.092968:0:13218:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787134816.109029:0:13218:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787134816.109444:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.109461:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.109467:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.109474:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.109546:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787134816.109551:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787134816.109574:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787134816.109585:0:13218:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff98aa7f66f800 x1873946312011520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787134830 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134816.109603:0:13218:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787134816.109609:0:13218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787134816.109615:0:13218:0:(import.c:65:import_set_state_nolock()) ffff98aa7faa8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787134816.109620:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787134816.109624:0:13218:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff98aa7f66f800 x1873946312011520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787134830 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134816.109630:0:13218:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787134816.109633:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1787134816.109832:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1873946312011520:0@lo:38:kworker.0 00010000:00010000:3.0:1787134816.114657:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134816.114674:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134816.114715:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa41671200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134816.114722:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134816.114734:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134816.114743:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134816.114749:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787134816.114752:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787134816.114756:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787134816.114812:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134816.114819:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134816.114869:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134816.114877:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa41671200/0x69932dacae905ded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134816.114895:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134816.114897:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134816.114899:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134816.114917:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787134816.114942:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312011776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134816.115025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134816.115451:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312011776 00000100:00100000:2.0:1787134816.115461:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312011776 00000100:00100000:2.0:1787134816.115519:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787134816.115528:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1873946312011776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787134816.115534:0:5820:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787134816 with bad export cookie 7607474415245220559 00010000:00010000:0.0:1787134816.118414:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.118434:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.118453:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.118458:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.118478:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787134816.118486:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.118503:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.118510:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.118517:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134816.118540:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787134816.118544:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787134816.118568:0:13218:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787134816.118574:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787134816.118579:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787134816.118585:0:13218:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787134816.118589:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff98aa6ff5b380) has no exports 00000020:00080000:0.0:1787134816.118613:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff98aa6ff5b380) has no exports 00000020:01000000:0.0:1787134816.120365:0:13218:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98aa81f0f180 - data ffff98aa7ffef360/ffff98aa6fc2a800 00000020:01000000:0.0:1787134816.120570:0:13218:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98aa721a9720 - data ffff98aa7fe13bd0/ffff98aa7fbd9000 00010000:00010000:1.0:1787134816.124301:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787134816.124319:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124356:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa41670c00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134816.124360:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124369:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134816.124377:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134816.124382:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787134816.124384:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787134816.124388:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787134816.124432:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124439:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787134816.124469:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124475:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa41670c00/0x69932dacae905dfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae905e02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124489:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134816.124493:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124499:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97c00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134816.124502:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124516:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134816.124522:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134816.124528:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787134816.124530:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787134816.124532:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787134816.124546:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124552:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787134816.124570:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124576:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97c00/0x69932dacae906032 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x69932dacae906039 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134816.124586:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134816.124588:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134816.124590:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134816.124610:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134816.124630:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946312012032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787134816.124702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787134816.127586:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134816.127654:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312011904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134816.127737:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134816.129564:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312012032 00000100:00100000:2.0:1787134816.129578:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312012032 00000100:00100000:2.0:1787134816.129619:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312011904 00000100:00100000:2.0:1787134816.129623:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312011904 00000100:00100000:2.0:1787134816.129638:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787134816.129646:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942204000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1873946312012032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787134816.129667:0:5821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787134816 with bad export cookie 7607474415245220559 00000100:00100000:2.0:1787134816.129741:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942204000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1873946312012032:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (5038us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787134816.129749:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787134816.129767:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787134816.129771:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa42d62850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1873946312011904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787134816.129775:0:5821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787134816 with bad export cookie 7607474415245220559 00000100:00100000:2.0:1787134816.129805:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa42d62850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1873946312011904:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (2068us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787134816.129811:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787134816.130024:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1873946312011776:12345-0@lo:103:ldlm_bl.0 Request processed in 14496us (14997us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787134816.130031:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787134816.130652:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.136@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787134816.130658:0:3310:0:(import.c:65:import_set_state_nolock()) ffff98aa6aa87800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787134816.130661:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787134816.135646:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.136@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787134816.142092:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.136@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787134816.142099:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787134816.142110:0:3310:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff98aa7f66e680 x1873946312011392/t0(0) o400->MGC192.168.202.136@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787134831 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134816.142129:0:3310:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff98aa7f66e300 x1873946312011776/t0(0) o103->MGC192.168.202.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787134832 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134816.142151:0:3310:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a942205500 x1873946312012032/t0(0) o103->MGC192.168.202.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787134832 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134816.142194:0:3310:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a942205c00 x1873946312011904/t0(0) o103->MGC192.168.202.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787134832 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787134816.142203:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787134816.142206:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787134816.142208:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787134816.142979:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98aa6aa87800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787134816.143007:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946312011392:0@lo:400:kworker.0 00000100:00100000:1.0:1787134816.143058:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3308:1873946312012032:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787134816.143121:0:3310:0:(import.c:65:import_set_state_nolock()) ffff98aa6aa87800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787134816.143128:0:3310:0:(import.c:510:import_select_connection()) MGC192.168.202.136@tcp: connect to NID 0@lo last attempt 161 00000100:00080000:3.0:1787134816.143588:0:3310:0:(import.c:624:import_select_connection()) MGC192.168.202.136@tcp: import ffff98aa6aa87800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787134816.143622:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa7f66d880 x1873946312012160/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787134816.143678:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3306:1873946312012160:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1787134816.143736:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873946312012160 offset 0 length 520: 4 00000100:00100000:3.0:1787134816.143807:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312011776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134816.143827:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3310:1873946312011904:0@lo:103:ldlm_bl.0 00100000:10000000:1.0:1787134816.158149:0:13218:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787134816.183948:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905c0a 00000020:00000080:0.0:1787134816.183959:0:13218:0:(genops.c:906:class_export_put()) final put ffff98aa7f7e3000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787134816.183983:0:13218:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98aa438c0800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787134816.183987:0:13218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa438c0800 2 00000020:01000004:0.0:1787134816.183990:0:13218:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98aa438c0800 from lustre-OST0000 00000020:00000080:0.0:1787134816.184016:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787134816.184027:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787134816.184029:0:13218:0:(genops.c:906:class_export_put()) final put ffff98aa7f7e1000/lustre-OST0000_UUID 00000020:00000080:0.0:1787134816.184032:0:13218:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7f7e1000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787134816.184040:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787134816.184083:0:13218:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787134816.184088:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787134816.184093:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787134816.184098:0:13218:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787134816.184106:0:13218:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98aa7faad000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787134816.184112:0:13218:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff98aa6ff899c0) has exports, disconnecting them 00000020:00080000:0.0:1787134816.184117:0:13218:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98aa7faad000), last request at 1787134563 00000020:00000080:0.0:1787134816.184122:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905c34 00000020:00080000:0.0:1787134816.184132:0:13218:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98aa7faad000): rc 0 00000020:00000080:0.0:1787134816.184136:0:13218:0:(genops.c:906:class_export_put()) final put ffff98aa7faad000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787134816.185068:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7f7e3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787134816.185084:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7faad000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787134816.189236:0:13218:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787134816.189245:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787134816.189251:0:13218:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787134816.189265:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787134816.189413:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787134816.189424:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787134816.189432:0:13218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa438c0800 1 00000020:00000080:2.0:1787134816.189440:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905bc4 00000020:00000080:2.0:1787134816.189448:0:13218:0:(genops.c:906:class_export_put()) final put ffff98aa74088800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787134816.189455:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787134816.189470:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787134816.189474:0:13218:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787134816.189478:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff98aa6ff5cd40) has no exports 00000020:00000080:3.0:1787134816.189894:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa7faa8800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787134816.189902:0:475:0:(genops.c:906:class_export_put()) final put ffff98aa7faab000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787134816.189905:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa7faab000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787134816.189915:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787134816.189978:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa74088800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:3.0:1787134816.193312:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787134816.209016:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787134816.209035:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787134816.209041:0:13218:0:(genops.c:906:class_export_put()) final put ffff98aa51557000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787134816.209046:0:13218:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa51557000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787134816.209054:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787134816.209307:0:13218:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98aa438c1800 00000020:02000400:3.0:1787134816.209361:0:13218:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787134817.217647:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134818.241314:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134819.269976:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787134819.283805:0:13369:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787134819.302311:0:13369:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787134819.302438:0:13369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.302456:0:13369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.302464:0:13369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.302487:0:13369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.302507:0:13369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787134819.302513:0:13369:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787134819.302655:0:13369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787134819.302669:0:13369:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff98aa7f66ca80 x1873946312011648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787134830 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134819.302687:0:13369:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787134819.302693:0:13369:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787134819.302700:0:13369:0:(import.c:65:import_set_state_nolock()) ffff98aa6f898800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787134819.302706:0:13369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787134819.302710:0:13369:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff98aa7f66ca80 x1873946312011648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787134830 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134819.302717:0:13369:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787134819.302720:0:13369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:2.0:1787134819.303022:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1873946312011648:0@lo:38:kworker.0 00010000:00010000:1.0:1787134819.304944:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134819.304961:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.304973:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa41670600 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134819.304979:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.304990:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134819.304998:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134819.305004:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787134819.305006:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787134819.305009:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787134819.305025:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98aa6aa87800 00010000:00010000:1.0:1787134819.305029:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.305036:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa41670600/0x69932dacae905dd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x69932dacae905dd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.305050:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134819.305051:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134819.305069:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134819.307669:0:13369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.307690:0:13369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.307698:0:13369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.307705:0:13369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.307749:0:13369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787134819.307757:0:13369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.307763:0:13369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.307769:0:13369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.307775:0:13369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134819.307793:0:13369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787134819.307797:0:13369:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787134819.307819:0:13369:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787134819.307824:0:13369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787134819.307828:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787134819.307834:0:13369:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787134819.307837:0:13369:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98aa4334b380) has no exports 00000020:00080000:0.0:1787134819.307863:0:13369:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98aa4334b380) has no exports 00010000:00010000:1.0:1787134819.308633:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787134819.308643:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.308652:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa41670e00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134819.308656:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.308666:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134819.308673:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134819.308679:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787134819.308681:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787134819.308684:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787134819.308697:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98aa6aa87800 00010000:00010000:1.0:1787134819.308702:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.308709:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa41670e00/0x69932dacae905ddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x69932dacae905de6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.308724:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134819.308727:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.308732:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7be00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1787134819.308734:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.308752:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787134819.308758:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134819.308763:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787134819.308766:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787134819.308767:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787134819.308772:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98aa6aa87800 00010000:00010000:1.0:1787134819.308775:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.308782:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7be00/0x69932dacae906024 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x69932dacae90602b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134819.308795:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134819.308797:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134819.308798:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134819.308835:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787134819.311627:0:13369:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98aa81d57720 - data ffff98aa6b06c000/ffff98aa7f6fa400 00000020:01000000:0.0:1787134819.311791:0:13369:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98aa47e118a0 - data ffff98aa6b03caf8/ffff98aa81e20400 00100000:10000000:2.0:1787134819.333755:0:13369:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787134819.362935:0:13369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905cd5 00000020:00000080:2.0:1787134819.362948:0:13369:0:(genops.c:906:class_export_put()) final put ffff98aa764ce800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787134819.363012:0:13369:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98aa52a7d800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787134819.363017:0:13369:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa52a7d800 2 00000020:01000004:2.0:1787134819.363020:0:13369:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98aa52a7d800 from lustre-OST0001 00000020:00000080:2.0:1787134819.363043:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787134819.363054:0:13369:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787134819.363057:0:13369:0:(genops.c:906:class_export_put()) final put ffff98aa551b7800/lustre-OST0001_UUID 00000020:00000080:2.0:1787134819.363060:0:13369:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa551b7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787134819.363066:0:13369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787134819.363319:0:13369:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e5b817d2-f0c2-441a-949c-994c1ff95f2c->MGS 00010000:00010000:2.0:1787134819.363336:0:13369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905bee expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134819.363349:0:13369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905bee expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134819.363355:0:13369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787134819.363358:0:13369:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787134819.363361:0:13369:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787134819.363377:0:13369:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98aa6aa87800 00010000:00010000:2.0:1787134819.363380:0:13369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa413fd400/0x69932dacae905be7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x69932dacae905bee expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134819.363838:0:13369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x69932dacae905e2c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134819.363866:0:13369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x69932dacae905e2c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134819.363872:0:13369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787134819.363874:0:13369:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787134819.363876:0:13369:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787134819.363886:0:13369:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98aa6aa87800 00010000:00010000:2.0:1787134819.363889:0:13369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa59deb000/0x69932dacae905e25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x69932dacae905e2c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787134819.363906:0:13369:0:(import.c:65:import_set_state_nolock()) ffff98aa6aa87800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787134819.363910:0:13369:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787134819.363913:0:13369:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787134819.363914:0:13369:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787134819.363918:0:13369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787134819.363930:0:13369:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff98aa7f66d880 x1873946312012160/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787134826 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787134819.363951:0:13369:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787134819.363954:0:13369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1787134819.363992:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5b817d2-f0c2-441a-949c-994c1ff95f2c:3306:1873946312012160:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:2.0:1787134819.364020:0:13369:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787134819.364026:0:13369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905ac8 00000020:00000080:2.0:1787134819.364031:0:13369:0:(genops.c:906:class_export_put()) final put ffff98aa6aa86000/e5b817d2-f0c2-441a-949c-994c1ff95f2c 00000020:00000080:1.0:1787134819.364345:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa764ce800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787134819.364533:0:13369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.136@tcp (flags='') 00000020:00000080:2.0:1787134819.364542:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787134819.364549:0:13369:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.136@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787134819.364554:0:13369:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff98aa6aa4b380) has no exports 10000000:01000000:0.0:1787134819.364812:0:5832:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787134819.364913:0:13369:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.136@tcp: client import never connected 00000100:00080000:2.0:1787134819.364916:0:13369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787134819.364926:0:13369:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787134819.364929:0:13369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787134819.364931:0:13369:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787134819.364972:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6aa86000/e5b817d2-f0c2-441a-949c-994c1ff95f2c for MGC192.168.202.136@tcp 00000020:00000080:2.0:1787134819.365329:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787134819.365338:0:13369:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.136@tcp (uuid e5b817d2-f0c2-441a-949c-994c1ff95f2c) 00000020:01000000:2.0:1787134819.365344:0:13369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787134819.365348:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787134819.365353:0:13369:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787134819.365359:0:13369:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98aa6faba000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787134819.365365:0:13369:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff98aa43348000) has exports, disconnecting them 00000020:00080000:2.0:1787134819.365370:0:13369:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98aa6faba000), last request at 1787134582 00000020:00000080:2.0:1787134819.365376:0:13369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905cff 00000020:00000080:1.0:1787134819.365501:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa6aa87800 for MGC192.168.202.136@tcp 00000020:00000080:1.0:1787134819.365509:0:475:0:(genops.c:906:class_export_put()) final put ffff98aa5407d800/e5b817d2-f0c2-441a-949c-994c1ff95f2c 00000020:00000080:1.0:1787134819.365511:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa5407d800/e5b817d2-f0c2-441a-949c-994c1ff95f2c for MGC192.168.202.136@tcp 00000020:01000000:1.0:1787134819.365518:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.136@tcp (e5b817d2-f0c2-441a-949c-994c1ff95f2c) 00000020:00080000:2.0:1787134819.365995:0:13369:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98aa6faba000): rc 0 00000020:00000080:2.0:1787134819.366000:0:13369:0:(genops.c:906:class_export_put()) final put ffff98aa6faba000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787134819.367078:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6faba000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787134819.375979:0:13369:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787134819.375988:0:13369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787134819.375992:0:13369:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787134819.375999:0:13369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787134819.376345:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787134819.376668:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1787134819.376818:0:5818:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98aa47a06600:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1787134819.376908:0:5819:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98aa46308e00:5819] 1 exiting: rc = 0 00000100:00100000:2.0:1787134819.377002:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377412:0:5822:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98aa46309800:5822] 2 exiting: rc = 0 00000100:00100000:2.0:1787134819.377470:0:5820:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98aa46308000:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1787134819.377624:0:5821:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98aa46308200:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1787134819.377685:0:7620:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98aa52a67000:7620] 3 exiting: rc = 0 00000100:00100000:2.0:1787134819.377784:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377793:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377800:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377805:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377810:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377815:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377820:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377825:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377832:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377848:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377853:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377858:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377863:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377869:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377874:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377880:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377885:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377893:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377898:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377903:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377909:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377914:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377918:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377922:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377927:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377931:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377935:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377940:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377944:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.377948:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378325:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378331:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378336:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378342:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378348:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378353:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378359:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378366:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378371:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378376:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378382:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378455:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378465:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378469:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378484:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378489:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378494:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378500:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378505:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378511:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378517:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378522:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378527:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378533:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378538:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378544:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378551:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378556:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378560:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378566:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378571:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378576:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378580:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.378585:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787134819.379399:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa6f898800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787134819.379607:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787134819.379617:0:13369:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787134819.379624:0:13369:0:(genops.c:906:class_export_put()) final put ffff98aa6fabc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787134819.379628:0:13369:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa6fabc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787134819.379634:0:13369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787134819.379687:0:13369:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa52a7d800 1 00000020:00000080:2.0:1787134819.379694:0:13369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x69932dacae905ca4 00000020:00000080:2.0:1787134819.379702:0:13369:0:(genops.c:906:class_export_put()) final put ffff98aa551b0800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787134819.379718:0:13369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787134819.379723:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787134819.379728:0:13369:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787134819.379731:0:13369:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98aa6aa499c0) has no exports 00000020:00000080:1.0:1787134819.380153:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa551b0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787134819.401018:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787134819.401036:0:13369:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787134819.401041:0:13369:0:(genops.c:906:class_export_put()) final put ffff98aa52a7f800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787134819.401046:0:13369:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa52a7f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787134819.401057:0:13369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787134819.401343:0:13369:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98aa52a7e000 00000020:01000000:0.0:1787134819.401367:0:13369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787134819.401372:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787134819.401376:0:13369:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787134819.401380:0:13369:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff98aa6ff599c0) has no exports 00000020:00000080:0.0:1787134819.401420:0:13369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787134819.401426:0:13369:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787134819.401429:0:13369:0:(genops.c:906:class_export_put()) final put ffff98aa74088000/OSS_uuid 00000020:00000080:0.0:1787134819.401432:0:13369:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa74088000/OSS_uuid for OSS 00000020:01000000:0.0:1787134819.401435:0:13369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787134819.401465:0:5831:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787134819.402005:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff98aa81b9be00:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1787134819.402059:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff98aa52783200:6682] 2 exiting: rc = 0 00000100:00100000:0.0:1787134819.402113:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff98aa7bc72e00:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1787134819.402196:0:7839:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff98aa81e57200:7839] 3 exiting: rc = 0 00000100:00100000:1.0:1787134819.403682:0:11954:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff98aa7bd70c00:11954] 4 exiting: rc = 0 00000100:00100000:0.0:1787134819.404341:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404353:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404374:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404383:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404400:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404407:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404413:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404419:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404424:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404430:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404436:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404442:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404446:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404467:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404472:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404478:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404483:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404487:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404492:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404498:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404513:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404519:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404523:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404529:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404535:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404540:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404547:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404552:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404557:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404562:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404567:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404572:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404577:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404583:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404587:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404592:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404597:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404602:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404607:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404612:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404617:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404622:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404628:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404633:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404648:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404655:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404659:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404665:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404676:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404681:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404686:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404691:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404697:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404702:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404709:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404715:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404720:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404725:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404730:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404734:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404739:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404745:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404750:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.404761:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.409412:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98aa7ae58600:6685] 1 exiting: rc = 0 00000100:00100000:1.0:1787134819.409543:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98aa7bc72c00:6684] 0 exiting: rc = 1 00000100:00100000:0.0:1787134819.410190:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410202:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410208:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410214:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410220:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410233:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410240:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410246:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410251:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410256:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410261:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410266:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410270:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410275:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410280:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410286:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410298:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410311:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410317:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410339:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410343:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410348:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410353:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410358:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410363:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410367:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410372:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410377:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410381:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410708:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410719:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410725:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410731:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410737:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410741:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410746:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410751:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410756:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410761:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410766:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410770:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410775:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410780:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410786:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410791:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410796:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410802:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410808:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410816:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410821:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410826:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410832:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410840:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410846:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410862:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410867:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410872:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410878:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410883:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410888:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410893:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410898:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410903:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787134819.410909:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.422485:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98aa7ae58800:6687] 1 exiting: rc = 0 00000100:00100000:2.0:1787134819.423591:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98aa52782600:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1787134819.423935:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98aa7ae58e00:6688] 2 exiting: rc = 0 00000100:00100000:1.0:1787134819.427011:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427021:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427026:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427031:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427038:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427066:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427073:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427079:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427085:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427090:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427095:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427101:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427107:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427124:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427130:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427136:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427142:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427148:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427154:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427174:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427189:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427196:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427201:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427206:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427212:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427217:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427223:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427241:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427247:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427267:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427289:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427295:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427301:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427317:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427324:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427330:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427336:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427342:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427348:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427355:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427361:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427368:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427375:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.427381:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428279:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428311:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428318:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428324:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428330:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428336:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428343:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428349:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428355:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428383:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428399:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428405:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428412:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428418:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428425:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428433:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428440:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428449:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428456:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787134819.428462:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134819.457894:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98aa52783c00:6689] 0 exiting: rc = 1 00000100:00100000:0.0:1787134819.458017:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98aa52782800:6690] 1 exiting: rc = 0 00000100:00100000:2.0:1787134819.458611:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458634:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458639:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458644:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458649:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458655:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458661:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458667:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458672:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458677:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458683:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458688:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458694:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458699:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458717:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458724:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458729:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458735:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458741:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458746:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458752:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458757:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458763:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458769:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458774:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458780:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458786:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458792:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458797:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458803:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458849:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458855:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458860:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458865:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458870:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458875:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458889:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458894:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458899:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458904:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458909:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458913:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458918:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458923:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458928:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458934:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458939:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458944:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458949:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458954:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458959:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458963:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458969:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458974:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458979:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458983:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458990:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.458994:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.459000:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.459006:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.459011:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.459016:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.459021:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.459026:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787134819.462488:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98aa7ae59400:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1787134819.462767:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98aa7ae59a00:6692] 1 exiting: rc = 0 00000100:00100000:2.0:1787134819.462895:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462910:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462917:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462924:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462930:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462939:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462945:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462956:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462962:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462968:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462987:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462993:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.462999:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463005:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463012:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463017:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463024:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463029:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463035:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463041:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463046:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463053:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463069:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463075:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463081:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463086:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463092:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463099:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463104:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463109:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463116:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463122:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463128:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463133:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463152:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463193:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463200:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463205:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463210:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463216:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463222:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463237:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463251:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463257:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463262:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463268:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463288:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463296:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463318:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463324:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463331:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463337:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463343:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463349:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463355:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463362:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463367:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463373:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463609:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463619:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463624:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463632:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463638:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787134819.463650:0:13369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787134819.480890:0:13369:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787134838.906460:0:13987:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787134848.238918:0:14449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787134848.238926:0:14449:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787134848.244617:0:14449:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98aa458e9800 00000020:01000004:3.0:1787134848.244642:0:14449:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787134848.244652:0:14449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787134848.244668:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98aa4334cd40) 00000020:00000080:3.0:1787134848.244683:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787134848.262661:0:14449:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787134848.264098:0:14449:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787134848.264442:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1787134848.264506:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1787134848.264626:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1787134848.264688:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1787134848.264772:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1787134848.264940:0:14449:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787134848.264999:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1787134848.265272:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 197: rc = 0 00100000:10000000:3.0:1787134848.266494:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 377: rc = 0 00100000:10000000:3.0:1787134848.266566:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 377: rc = 0 00100000:10000000:3.0:1787134848.267117:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 91: rc = 0 00100000:10000000:3.0:1787134848.267454:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 91: rc = 0 00100000:10000000:3.0:1787134848.267697:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 91: rc = 0 00100000:10000000:3.0:1787134848.267978:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 91: rc = 0 00100000:10000000:3.0:1787134848.268258:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 91: rc = 0 00100000:10000000:3.0:1787134848.268498:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 91: rc = 0 00100000:10000000:3.0:1787134848.268729:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 91: rc = 0 00100000:10000000:3.0:1787134848.268987:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 91: rc = 0 00100000:10000000:3.0:1787134848.269248:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 91: rc = 0 00100000:10000000:3.0:1787134848.269465:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 91: rc = 0 00100000:10000000:3.0:1787134848.269713:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 91: rc = 0 00100000:10000000:3.0:1787134848.269941:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 91: rc = 0 00100000:10000000:3.0:1787134848.271055:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 463: rc = 0 00100000:10000000:3.0:1787134848.272867:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 463: rc = 0 00100000:10000000:3.0:1787134848.273286:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 463: rc = 0 00100000:10000000:3.0:1787134848.273842:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 463: rc = 0 00100000:10000000:3.0:1787134848.274476:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 463: rc = 0 00100000:10000000:3.0:1787134848.274688:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 463: rc = 0 00100000:10000000:3.0:1787134848.274938:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 463: rc = 0 00100000:10000000:3.0:1787134848.275426:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 463: rc = 0 00100000:10000000:3.0:1787134848.275682:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 463: rc = 0 00100000:10000000:3.0:1787134848.276038:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 463: rc = 0 00100000:10000000:3.0:1787134848.276758:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 463: rc = 0 00100000:10000000:3.0:1787134848.277362:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 463: rc = 0 00100000:10000000:3.0:1787134848.277639:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 463: rc = 0 00100000:10000000:3.0:1787134848.278009:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 463: rc = 0 00100000:10000000:3.0:1787134848.278358:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 463: rc = 0 00100000:10000000:3.0:1787134848.278607:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 463: rc = 0 00100000:10000000:3.0:1787134848.278977:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 463: rc = 0 00100000:10000000:3.0:1787134848.279336:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 463: rc = 0 00100000:10000000:3.0:1787134848.279638:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 463: rc = 0 00100000:10000000:3.0:1787134848.280825:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 463: rc = 0 00100000:10000000:3.0:1787134848.281286:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 463: rc = 0 00100000:10000000:3.0:1787134848.281540:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 463: rc = 0 00100000:10000000:3.0:1787134848.281782:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 463: rc = 0 00100000:10000000:3.0:1787134848.282344:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 463: rc = 0 00100000:10000000:3.0:1787134848.282582:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 463: rc = 0 00100000:10000000:3.0:1787134848.282844:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 463: rc = 0 00100000:10000000:3.0:1787134848.283194:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 463: rc = 0 00100000:10000000:3.0:1787134848.283501:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 463: rc = 0 00100000:10000000:3.0:1787134848.283730:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 463: rc = 0 00100000:10000000:3.0:1787134848.284083:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 463: rc = 0 00100000:10000000:3.0:1787134848.284710:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 463: rc = 0 00100000:10000000:3.0:1787134848.285005:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 463: rc = 0 00100000:10000000:3.0:1787134848.285416:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 593: rc = 0 00100000:10000000:3.0:1787134848.285929:0:14449:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787134848.286120:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 453: rc = 0 00100000:10000000:3.0:1787134848.286362:0:14449:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787134848.286431:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 453: rc = 0 00100000:10000000:3.0:1787134848.286609:0:14449:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787134848.286677:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 453: rc = 0 00100000:10000000:3.0:1787134848.287077:0:14449:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787134848.287150:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 378: rc = 0 00100000:10000000:3.0:1787134848.287389:0:14449:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787134848.287455:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 378: rc = 0 00100000:10000000:3.0:1787134848.288178:0:14449:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787134848.288320:0:14449:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 378: rc = 0 00000020:00000080:3.0:1787134848.289587:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787134848.289601:0:14449:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787134848.289616:0:14449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae906dc9 00000020:01000004:3.0:1787134848.289626:0:14449:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787134848.289635:0:14449:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787134848.289641:0:14449:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98aa458e9800 from MGS 00000020:01000004:3.0:1787134848.289646:0:14449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787134848.289658:0:14449:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98aa433499c0) 00000020:00000080:3.0:1787134848.289670:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787134848.289726:0:14449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa458e9800 from MGS, refs=2 00080000:01000000:3.0:1787134848.289731:0:14449:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787134848.289736:0:14449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae906dd7 00000100:00100000:3.0:1787134848.290078:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787134848.290524:0:14449:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787134848.290532:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787134848.293296:0:14449:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787134848.293309:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787134848.294120:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134848.294452:0:14449:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787134848.294459:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787134848.294986:0:14449:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787134848.294992:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787134848.295607:0:14449:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787134848.295614:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787134848.296398:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134848.296401:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134848.296403:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134848.296709:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134848.296712:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134848.296713:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134848.301841:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134848.302002:0:14449:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1787134848.330056:0:14449:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787134848.330078:0:14449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787134848.330086:0:14449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787134848.338260:0:14458:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787134848.338469:0:14449:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787134848.338573:0:14449:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787134848.340340:0:14449:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787134848.340663:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134848.340840:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787134848.340847:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787134848.343627:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787134848.343640:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787134848.343999:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787134848.344005:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787134848.344644:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787134848.344665:0:14449:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.136@tcp' 00000020:01000004:2.0:1787134848.344666:0:14449:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787134848.344693:0:14449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.136@tcp (typ=mgc) 00000020:00000080:2.0:1787134848.344705:0:14449:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.136@tcp (ffff98aa6ff58000) 00000020:00000080:2.0:1787134848.344721:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787134848.344792:0:14449:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa7ae12800@MGC192.168.202.136@tcp: add connection 192.168.202.136@tcp at head 00010000:00010000:2.0:1787134848.345036:0:14449:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.136@tcp-0 is initialized 00000040:01000000:2.0:1787134848.345043:0:14449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787134848.346028:0:14462:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787134848.348191:0:14463:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787134848.348302:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.136@tcp (uuid 787f8101-2629-402b-af83-ff6c365f26f7) 00000020:00000080:3.0:1787134848.348334:0:14449:0:(genops.c:1406:class_connect()) connect: client 787f8101-2629-402b-af83-ff6c365f26f7, cookie 0x69932dacae906de5 00000100:00080000:3.0:1787134848.348351:0:14449:0:(import.c:510:import_select_connection()) MGC192.168.202.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787134848.348358:0:14449:0:(import.c:624:import_select_connection()) MGC192.168.202.136@tcp: import ffff98aa7ae12800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787134848.348399:0:14449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa7f66e300 x1873946312012288/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787134848.348432:0:14449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 787f8101-2629-402b-af83-ff6c365f26f7->MGS 00000020:01000004:3.0:1787134848.348464:0:14449:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787134848.348470:0:14449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787134848.348486:0:14449:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98aa43348000) 00000020:00000080:3.0:1787134848.348500:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787134848.352099:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:787f8101-2629-402b-af83-ff6c365f26f7:3306:1873946312012288:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787134848.352206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134848.352305:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312012288 00000100:00100000:2.0:1787134848.352314:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312012288 00000100:00100000:2.0:1787134848.352356:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134848.352363:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1873946312012288:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787134848.352391:0:14459:0:(ldlm_lib.c:1449:target_handle_connect()) MGS: connection from 787f8101-2629-402b-af83-ff6c365f26f7@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1787134848.352422:0:14459:0:(genops.c:1406:class_connect()) connect: client 787f8101-2629-402b-af83-ff6c365f26f7, cookie 0x69932dacae906df3 00000100:00080000:2.0:1787134848.352564:0:14459:0:(import.c:65:import_set_state_nolock()) ffff98aa7ae11000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787134848.352625:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+5:3306:x1873946312012288:12345-0@lo:250:mount.lustre.0 Request processed in 260us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134848.352632:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134848.352680:0:3306:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787134848.352701:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.136@tcp: connect to target with instance 0 00000100:00080000:2.0:1787134848.352710:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787134848.352715:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787134848.352717:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa7ae12800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787134848.352719:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787134848.352728:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787134848.352733:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:787f8101-2629-402b-af83-ff6c365f26f7:3306:1873946312012288:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787134848.366017:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787134848.366291:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787134848.366297:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787134848.367525:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787134848.367537:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787134848.367889:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787134848.367895:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787134848.369631:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134848.370035:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787134848.370044:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787134848.370635:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787134848.370642:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787134848.400319:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134848.400583:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787134848.400591:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787134848.402030:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787134848.402044:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787134848.402726:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134848.402910:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787134848.402916:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787134848.403464:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787134848.403471:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787134848.404069:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134848.404315:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787134848.404321:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787134848.404750:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787134848.404757:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787134848.405460:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134848.405617:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787134848.405630:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787134848.406071:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787134848.406077:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787134848.423133:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787134848.423561:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787134848.423568:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787134848.424916:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787134848.424928:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787134848.425768:0:14449:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787134848.425776:0:14449:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787134848.426589:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787134848.426614:0:14449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787134848.426621:0:14449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787134848.426773:0:14449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787134848.426820:0:14449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.136@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787134848.426826:0:14449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787134848.426828:0:14449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787134848.426830:0:14449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134848.426831:0:14449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134848.426833:0:14449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134848.426834:0:14449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134848.426835:0:14449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787134848.426837:0:14449:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787134848.426839:0:14449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134848.426840:0:14449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787134848.426843:0:14449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787134848.426845:0:14449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787134848.426846:0:14449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787134848.426848:0:14449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134848.426849:0:14449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134848.426850:0:14449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134848.426852:0:14449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134848.426853:0:14449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787134848.426854:0:14449:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787134848.426855:0:14449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134848.426856:0:14449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787134848.426889:0:14449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787134848.426913:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012416:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787134848.427002:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134848.427052:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa62035a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787134848.427198:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312012416 00000100:00100000:3.0:1787134848.427207:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312012416 00000100:00100000:3.0:1787134848.427255:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134848.427264:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+5:14449:x1873946312012416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787134848.427316:0:14461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787134848.427324:0:14461:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787134848.427327:0:14461:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787134848.428133:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787134848.428695:0:14461:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787134848.429772:0:14483:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787134848.429779:0:14483:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787134848.429782:0:14483:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787134848.429818:0:14483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787134848.430117:0:14461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787134848.430128:0:14461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787134848.435867:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+5:14449:x1873946312012416:12345-0@lo:253:mount.lustre.0 Request processed in 8592us (8854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134848.435886:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787134848.436044:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012416:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787134848.436063:0:14449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787134848.436066:0:14449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787134848.436068:0:14449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787134848.436070:0:14449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134848.436071:0:14449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134848.436072:0:14449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134848.436074:0:14449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134848.436075:0:14449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787134848.436077:0:14449:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787134848.436079:0:14449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134848.436080:0:14449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787134848.436100:0:14449:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98aa458e9800 from lustre-MDT0000 10000000:01000000:2.0:1787134848.436131:0:14449:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787134848.436134:0:14449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787134848.436139:0:14449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98aa6ff58000 10000000:01000000:2.0:1787134848.436143:0:14449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787134848.436151:0:14449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98aa6ff58000 from 1 10000000:01000000:2.0:1787134848.436154:0:14449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787134848.436381:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.436393:0:14449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.436403:0:14449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134848.436426:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787134848.436468:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134848.436545:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa51339900 going to sleep for 11 seconds 00000100:00100000:3.0:1787134848.436587:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312012544 00000100:00100000:3.0:1787134848.436593:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312012544 00000100:00100000:3.0:1787134848.436663:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787134848.436672:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+5:14449:x1873946312012544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787134848.436683:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134848.436699:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59dea200/0x69932dacae906e01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906dfa expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.436721:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea200/0x69932dacae906e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906dfa expref: 6 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.436732:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59dea200/0x69932dacae906e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906dfa expref: 6 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.436742:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea200, rc 0) 00000100:00100000:3.0:1787134848.436783:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+6:14449:x1873946312012544:12345-0@lo:101:mount.lustre.0 Request processed in 112us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134848.436789:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787134848.436844:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787134848.436858:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.436867:0:14449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134848.436925:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134848.436952:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.437093:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134848.437182:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312012672 00000100:00100000:2.0:1787134848.437186:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312012672 00000100:00100000:2.0:1787134848.437219:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787134848.437227:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+6:14449:x1873946312012672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787134848.437446:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+6:14449:x1873946312012672:12345-0@lo:501:mount.lustre.0 Request processed in 220us (492us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787134848.437453:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134848.437553:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012672:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787134848.437576:0:14449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787134848.437589:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.437604:0:14449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134848.437611:0:14449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98aa458e9800 10000000:01000000:0.0:1787134848.437628:0:14449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787134848.437633:0:14449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98aa458e9800 10000000:01000000:0.0:1787134848.437635:0:14449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787134848.437638:0:14449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98aa458e9800 from 1 10000000:01000000:0.0:1787134848.437640:0:14449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787134848.437658:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450800/0x69932dacae906e08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.437666:0:14449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa81450800/0x69932dacae906e08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.437673:0:14449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa81450800/0x69932dacae906e08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134848.437686:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787134848.437712:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.437741:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134848.437789:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312012800 00000100:00100000:2.0:1787134848.437793:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312012800 00000100:00100000:2.0:1787134848.437811:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787134848.437817:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+6:14449:x1873946312012800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787134848.437824:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134848.437835:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa96200/0x69932dacae906e0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906e08 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.437848:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa96200/0x69932dacae906e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906e08 expref: 7 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.437856:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa96200/0x69932dacae906e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906e08 expref: 7 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.437862:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96200, rc 0) 00000100:00100000:2.0:1787134848.437897:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+7:14449:x1873946312012800:12345-0@lo:101:mount.lustre.0 Request processed in 80us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134848.437904:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134848.438005:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787134848.438016:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa81450800/0x69932dacae906e08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e0f expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.438024:0:14449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa81450800/0x69932dacae906e08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906e0f expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134848.438048:0:14449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787134848.438057:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450800/0x69932dacae906e08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e0f expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.438064:0:14449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa81450800/0x69932dacae906e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e0f expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134848.438070:0:14449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787134848.438082:0:14449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787134848.438086:0:14449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98aa458e9800 10000000:01000000:0.0:1787134848.438089:0:14449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787134848.438092:0:14449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787134848.438093:0:14449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787134848.438107:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81451c00/0x69932dacae906e16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.438114:0:14449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa81451c00/0x69932dacae906e16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.438121:0:14449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa81451c00/0x69932dacae906e16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134848.438132:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787134848.438178:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.438194:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134848.438253:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312012928 00000100:00100000:2.0:1787134848.438258:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312012928 00000100:00100000:2.0:1787134848.438272:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787134848.438277:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+7:14449:x1873946312012928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787134848.438284:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134848.438299:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa97600/0x69932dacae906e1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906e16 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.438313:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa97600/0x69932dacae906e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906e16 expref: 8 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.438321:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa97600/0x69932dacae906e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906e16 expref: 8 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.438328:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97600, rc 0) 00000100:00100000:2.0:1787134848.438364:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+8:14449:x1873946312012928:12345-0@lo:101:mount.lustre.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134848.438370:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787134848.438437:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312012928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787134848.438448:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa81451c00/0x69932dacae906e16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e1d expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.438461:0:14449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa81451c00/0x69932dacae906e16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906e1d expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134848.438498:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312013056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134848.438524:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.438546:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134848.438592:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312013056 00000100:00100000:2.0:1787134848.438597:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312013056 00000100:00100000:2.0:1787134848.438613:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787134848.438618:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+8:14449:x1873946312013056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787134848.439048:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+9:14449:x1873946312013056:12345-0@lo:501:mount.lustre.0 Request processed in 428us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134848.439055:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787134848.439297:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312013056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134848.439330:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312013184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787134848.439369:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.439437:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134848.439469:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312013184 00000100:00100000:2.0:1787134848.439475:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312013184 00000100:00100000:2.0:1787134848.439542:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787134848.439551:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+9:14449:x1873946312013184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787134848.439842:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+9:14449:x1873946312013184:12345-0@lo:503:mount.lustre.0 Request processed in 291us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134848.439849:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787134848.439920:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312013184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787134848.440390:0:14484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14484:1873946312013312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134848.440430:0:14484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.441215:0:14484:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787134848.441399:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312013312 00000100:00100000:3.0:1787134848.441406:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312013312 00000100:00100000:0.0:1787134848.441507:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787134848.441515:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+9:14484:x1873946312013312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134848.441819:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+9:14484:x1873946312013312:12345-0@lo:502:llog_process_th.0 Request processed in 303us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.441826:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787134848.441879:0:14484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14484:1873946312013312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787134848.441918:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787134848.441929:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134848.441931:0:14484:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787134848.441943:0:14484:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787134848.441946:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787134848.441969:0:14484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98aa8147cd40) 00000020:00000080:0.0:1787134848.441988:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787134848.441994:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787134848.442064:0:14484:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787134848.442075:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae906e2b 00000020:00000080:0.0:1787134848.442300:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787134848.442305:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134848.442309:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134848.442310:0:14484:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787134848.442313:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787134848.442317:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134848.442318:0:14484:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787134848.442321:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787134848.442327:0:14484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98aa814799c0) 00000020:00000080:0.0:1787134848.442336:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787134848.442339:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787134848.442341:0:14484:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787134848.442344:0:14484:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787134848.442349:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787134848.442387:0:14484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa458e9800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787134848.442399:0:14484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98aa8147b380) 00000020:00000080:0.0:1787134848.442406:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787134848.442446:0:14484:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787134848.442451:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae906e40 00000020:00000080:0.0:1787134848.442541:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787134848.442547:0:14484:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787134848.442551:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x69932dacae906e47 00080000:01000000:0.0:1787134848.442555:0:14484:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787134848.442558:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae906e4e 00010000:00010000:3.0:1787134848.502500:0:14484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787134848.503127:0:14484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787134848.503519:0:14484:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787134848.504347:0:14484:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98aa4334b380) 00000020:00000080:3.0:1787134848.504375:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787134848.504461:0:14484:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787134848.504469:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae906e5c 00000020:00000080:1.0:1787134848.505092:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787134848.514654:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x69932dacae906e63 00000020:00000080:1.0:1787134848.515155:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787134848.515197:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134848.515213:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.515216:0:14484:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787134848.515220:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787134848.515223:0:14484:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787134848.515224:0:14484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787134848.515226:0:14484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787134848.515227:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787134848.515230:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.515232:0:14484:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787134848.515234:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134848.515239:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.515241:0:14484:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787134848.515245:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787134848.515280:0:14484:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787134848.515292:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134848.515294:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.515296:0:14484:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787134848.515298:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787134848.515301:0:14484:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787134848.515305:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.515306:0:14484:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787134848.515308:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787134848.515314:0:14484:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.136@tcp to nid 0x20000c0a8ca88 (192.168.202.136@tcp) 00000020:01000000:1.0:1787134848.515342:0:14484:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787134848.515344:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787134848.515363:0:14484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98aa6aa4b380) 00000020:00000080:1.0:1787134848.515378:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787134848.515391:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787134848.515446:0:14484:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787134848.515452:0:14484:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787134848.515460:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae906e71 00010000:00080000:1.0:1787134848.515492:0:14484:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa73ca9800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:1.0:1787134848.515745:0:14484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787134848.516123:0:14484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787134848.516205:0:14484:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787134848.520635:0:14484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134848.520732:0:14484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787134848.520803:0:14484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787134848.524993:0:14488:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787134848.525002:0:14488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787134848.526485:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787134848.526498:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787134848.526536:0:14484:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787134848.526557:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae906e78 00000100:00080000:1.0:1787134848.526569:0:14484:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787134848.526575:0:14484:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98aa73ca9800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787134848.526857:0:14484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a942205500 x1873946312013440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787134848.527003:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312013440:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787134848.527076:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873946312013440 offset 0 length 520: 4 00000100:00080000:1.0:1787134848.527137:0:14484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787134848.527255:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134848.527260:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.527263:0:14484:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787134848.527266:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787134848.527268:0:14484:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787134848.527270:0:14484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787134848.527272:0:14484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787134848.527273:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787134848.527276:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.527283:0:14484:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787134848.527286:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787134848.527290:0:14484:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787134848.527294:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.527295:0:14484:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787134848.527298:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787134848.527303:0:14484:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.136@tcp to nid 0x20000c0a8ca88 (192.168.202.136@tcp) 00000020:01000000:1.0:1787134848.527327:0:14484:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787134848.527329:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787134848.527343:0:14484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98aa6aa499c0) 00000020:00000080:1.0:1787134848.527358:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787134848.527364:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787134848.527433:0:14484:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787134848.527440:0:14484:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787134848.527447:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x69932dacae906e86 00010000:00080000:1.0:1787134848.527479:0:14484:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa51547000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:1.0:1787134848.527712:0:14484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787134848.528133:0:14484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787134848.528259:0:14484:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787134848.530131:0:14484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134848.530387:0:14484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787134848.530468:0:14484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787134848.531091:0:14490:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787134848.531097:0:14490:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787134848.532050:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787134848.532063:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787134848.532098:0:14484:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787134848.532118:0:14484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae906e8d 00000100:00080000:1.0:1787134848.532129:0:14484:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787134848.532136:0:14484:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98aa51547000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787134848.532381:0:14484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a942206d80 x1873946312013568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787134848.532440:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312013568:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787134848.532510:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873946312013568 offset 0 length 520: 4 00000100:00080000:1.0:1787134848.532567:0:14484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787134848.532636:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134848.532641:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.532642:0:14484:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787134848.532645:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134848.532650:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.532651:0:14484:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787134848.532654:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787134848.532656:0:14484:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787134848.532658:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134848.532661:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.532662:0:14484:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787134848.532664:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134848.532666:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.532667:0:14484:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787134848.532671:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787134848.532711:0:14484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14484:1873946312013696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134848.532762:0:14484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134848.532778:0:14484:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa43427600 going to sleep for 11 seconds 00000100:00100000:0.0:1787134848.533835:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312013696 00000100:00100000:0.0:1787134848.533847:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312013696 00000100:00100000:0.0:1787134848.533894:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787134848.533905:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+9:14484:x1873946312013696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134848.534870:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+9:14484:x1873946312013696:12345-0@lo:502:llog_process_th.0 Request processed in 963us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.534880:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787134848.535520:0:14484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14484:1873946312013696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134848.535564:0:14484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134848.535574:0:14484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.535576:0:14484:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787134848.535583:0:14484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787134848.535835:0:14449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787134848.535855:0:14449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787134848.535920:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81451c00/0x69932dacae906e16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e1d expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.535932:0:14449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa81451c00/0x69932dacae906e16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e1d expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134848.535941:0:14449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98aa458e9800 from 1 10000000:01000000:0.0:1787134848.535943:0:14449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787134848.535988:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.535997:0:14449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.536008:0:14449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134848.536031:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312013824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787134848.536083:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.536120:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134848.536313:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312013824 00000100:00100000:3.0:1787134848.536321:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312013824 00000100:00100000:3.0:1787134848.536370:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787134848.536379:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+9:14449:x1873946312013824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787134848.536391:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134848.536405:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906e94 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.536428:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906e94 expref: 10 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.536439:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906e94 expref: 10 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.536447:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59deb600, rc 0) 00000100:00100000:3.0:1787134848.536485:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+10:14449:x1873946312013824:12345-0@lo:101:mount.lustre.0 Request processed in 108us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134848.536492:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787134848.536588:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312013824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787134848.536601:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134848.536610:0:14449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134848.537304:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312013952:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787134848.537400:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134848.537428:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa43427600 going to sleep for 11 seconds 00000100:00100000:3.0:1787134848.537490:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312013952 00000100:00100000:3.0:1787134848.537496:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312013952 00000100:00100000:3.0:1787134848.537522:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787134848.537528:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+10:14449:x1873946312013952:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787134848.537542:0:14460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787134848.537552:0:14460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787134848.537625:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+10:14449:x1873946312013952:12345-0@lo:256:mount.lustre.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134848.537633:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787134848.537817:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312013952:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787134848.538631:0:14449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787134848.539621:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134848.539636:0:14449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134848.539646:0:14449:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa458e9800 from 1 10000000:01000000:1.0:1787134848.539649:0:14449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787134848.539695:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134848.539888:0:14449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134848.539901:0:14449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134848.539935:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787134848.540008:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134848.540050:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa43427600 going to sleep for 11 seconds 00000100:00100000:2.0:1787134848.540243:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312014080 00000100:00100000:2.0:1787134848.540251:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312014080 00000100:00100000:2.0:1787134848.540300:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787134848.540310:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+10:14449:x1873946312014080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787134848.540324:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134848.540339:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906ea2 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.540361:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906ea2 expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.540370:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906ea2 expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134848.540379:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96600, rc 0) 00000100:00100000:2.0:1787134848.540421:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+11:14449:x1873946312014080:12345-0@lo:101:mount.lustre.0 Request processed in 112us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134848.540428:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787134848.540619:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787134848.540633:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134848.540658:0:14449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134848.540728:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134848.540755:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134848.540784:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa43427600 going to sleep for 11 seconds 00000100:00100000:0.0:1787134848.540839:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312014208 00000100:00100000:0.0:1787134848.540843:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312014208 00000100:00100000:0.0:1787134848.540876:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787134848.540884:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+11:14449:x1873946312014208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134848.541331:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+11:14449:x1873946312014208:12345-0@lo:501:mount.lustre.0 Request processed in 447us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.541339:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787134848.541974:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134848.542020:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787134848.542071:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134848.542095:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa43427600 going to sleep for 11 seconds 00000100:00100000:0.0:1787134848.542330:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312014336 00000100:00100000:0.0:1787134848.542336:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312014336 00000100:00100000:0.0:1787134848.542378:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787134848.542387:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+11:14449:x1873946312014336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787134848.542558:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+11:14449:x1873946312014336:12345-0@lo:503:mount.lustre.0 Request processed in 172us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.542566:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787134848.542645:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787134848.543486:0:14492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14492:1873946312014464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134848.543537:0:14492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134848.543573:0:14492:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa434270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134848.543615:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312014464 00000100:00100000:2.0:1787134848.543622:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312014464 00000100:00100000:2.0:1787134848.543662:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787134848.543671:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+11:14492:x1873946312014464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134848.543901:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+11:14492:x1873946312014464:12345-0@lo:502:llog_process_th.0 Request processed in 231us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134848.544068:0:14492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14492:1873946312014464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134848.544101:0:14492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134848.544112:0:14492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.544114:0:14492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787134848.544123:0:14492:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa458e9800 00000020:00000080:1.0:1787134848.544126:0:14492:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787134848.544134:0:14492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134848.544137:0:14492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.544138:0:14492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787134848.544141:0:14492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134848.544143:0:14492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.544150:0:14492:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787134848.544155:0:14492:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa458e9800 00000020:00000080:1.0:1787134848.544195:0:14492:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787134848.544260:0:14492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134848.544264:0:14492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.544266:0:14492:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787134848.544269:0:14492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134848.544271:0:14492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.544272:0:14492:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787134848.544276:0:14492:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98aa458e9800 00000020:00000080:1.0:1787134848.544278:0:14492:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787134848.544316:0:14492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14492:1873946312014592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134848.544356:0:14492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134848.544380:0:14492:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa434270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134848.544488:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787134848.544524:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312014592 00000100:00100000:2.0:1787134848.544533:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312014592 00000100:00100000:2.0:1787134848.544553:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787134848.544559:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+11:14492:x1873946312014592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787134848.544713:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+11:14492:x1873946312014592:12345-0@lo:502:llog_process_th.0 Request processed in 152us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134848.544720:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787134848.545805:0:14492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14492:1873946312014592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787134848.545839:0:14492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134848.545844:0:14492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134848.545846:0:14492:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787134848.545851:0:14492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787134848.546019:0:14449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787134848.546040:0:14449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787134848.546051:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.546064:0:14449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134848.546108:0:14449:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787134848.546112:0:14449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98aa458e9800 10000000:01000000:0.0:1787134848.546115:0:14449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98aa458e9800 10000000:01000000:0.0:1787134848.546119:0:14449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787134848.546124:0:14449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa458e9800 from 1 10000000:01000000:0.0:1787134848.546127:0:14449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787134848.546181:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450400/0x69932dacae906eb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.546197:0:14449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa81450400/0x69932dacae906eb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.546278:0:14449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa81450400/0x69932dacae906eb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134848.546302:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787134848.546357:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.546393:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134848.546577:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312014720 00000100:00100000:0.0:1787134848.546585:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312014720 00000100:00100000:0.0:1787134848.546663:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787134848.546672:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+11:14449:x1873946312014720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787134848.546684:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134848.546709:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81450a00/0x69932dacae906eb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906eb0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.546733:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81450a00/0x69932dacae906eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906eb0 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.546744:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81450a00/0x69932dacae906eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906eb0 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.546753:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450a00, rc 0) 00000100:00100000:0.0:1787134848.546789:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+12:14449:x1873946312014720:12345-0@lo:101:mount.lustre.0 Request processed in 117us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.546795:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787134848.547019:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787134848.547033:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa81450400/0x69932dacae906eb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906eb7 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.547042:0:14449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa81450400/0x69932dacae906eb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906eb7 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134848.547085:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134848.547115:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.547189:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134848.547343:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312014848 00000100:00100000:1.0:1787134848.547348:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312014848 00000100:00100000:1.0:1787134848.547407:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787134848.547415:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:14449:x1873946312014848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134848.547650:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:14449:x1873946312014848:12345-0@lo:501:mount.lustre.0 Request processed in 236us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134848.547658:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787134848.547780:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134848.547810:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787134848.547846:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.547865:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7433a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134848.547879:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312014976 00000100:00100000:0.0:1787134848.547883:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312014976 00000100:00100000:0.0:1787134848.547986:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787134848.547996:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+12:14449:x1873946312014976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787134848.548140:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+12:14449:x1873946312014976:12345-0@lo:503:mount.lustre.0 Request processed in 145us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.548147:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787134848.548285:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312014976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787134848.556807:0:14494:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14494:1873946312015104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787134848.556896:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134848.557043:0:14494:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa43427000 going to sleep for 11 seconds 00000100:00100000:0.0:1787134848.557139:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312015104 00000100:00100000:0.0:1787134848.557147:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312015104 00000100:00100000:0.0:1787134848.559082:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787134848.559096:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+12:14494:x1873946312015104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134848.559434:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+12:14494:x1873946312015104:12345-0@lo:502:llog_process_th.0 Request processed in 341us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.559443:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787134848.560861:0:14494:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14494:1873946312015104:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787134848.560954:0:14494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787134848.560979:0:14494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98aa81478000) 00000020:00000080:0.0:1787134848.560998:0:14494:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787134848.561189:0:14494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa458e9800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787134848.561193:0:14494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98aa458e9800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787134848.561196:0:14494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa458e9800 4 00010000:00080000:0.0:1787134848.561646:0:14494:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa52a7a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:0.0:1787134848.567358:0:14494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787134848.567476:0:14494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787134848.567509:0:14494:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787134848.567521:0:14494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x69932dacae906ec5 00000100:00080000:0.0:1787134848.567532:0:14494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787134848.567537:0:14494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98aa52a7a800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787134848.567574:0:14494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa819e4a80 x1873946312015232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787134848.567601:0:14494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787134848.567835:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946312015232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787134848.567954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134848.568031:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312015232 00000100:00100000:2.0:1787134848.568038:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312015232 00000100:00100000:2.0:1787134848.568105:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134848.568113:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1873946312015232:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787134848.568187:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1873946312015232:12345-0@lo:38:llog_process_th.0 Request processed in 73us (231us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787134848.568194:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134848.568353:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787134848.568361:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa52a7a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787134848.568365:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787134848.568369:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946312015232:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787134848.568558:0:14494:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14494:1873946312015360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134848.568605:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.568630:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312015360 00000100:00100000:0.0:1787134848.568633:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312015360 00000100:00100000:0.0:1787134848.568659:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787134848.568666:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:14494:x1873946312015360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787134848.568900:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:14494:x1873946312015360:12345-0@lo:502:llog_process_th.0 Request processed in 233us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.568987:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787134848.569036:0:14494:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa524eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134848.569050:0:14494:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:787f8101-2629-402b-af83-ff6c365f26f7:14494:1873946312015360:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787134848.569073:0:14494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787134848.569129:0:14449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787134848.569149:0:14449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787134848.569191:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450400/0x69932dacae906eb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906eb7 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.569276:0:14449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa81450400/0x69932dacae906eb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906eb7 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787134848.569328:0:14449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787134848.569330:0:14449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787134848.569332:0:14449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134848.569333:0:14449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134848.569335:0:14449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134848.569336:0:14449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134848.569337:0:14449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787134848.569339:0:14449:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787134848.569341:0:14449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134848.569342:0:14449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787134848.569346:0:14449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787134848.569348:0:14449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787134848.569350:0:14449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787134848.569351:0:14449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134848.569352:0:14449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134848.569353:0:14449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134848.569354:0:14449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134848.569355:0:14449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787134848.569356:0:14449:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787134848.569361:0:14449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134848.569362:0:14449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787134848.569375:0:14449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787134848.569384:0:14449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312015488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787134848.569416:0:14449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.569431:0:14449:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa524eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134848.569446:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312015488 00000100:00100000:0.0:1787134848.569451:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312015488 00000100:00100000:0.0:1787134848.569472:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787134848.569478:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+12:14449:x1873946312015488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787134848.569508:0:14459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787134848.569521:0:14459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787134848.622529:0:14459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787134848.622550:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787134848.622630:0:14482:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787134848.622636:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787134848.622659:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.622679:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906e94 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.622689:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.622737:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae906e94 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.622750:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae906e94 expref: 12 pid: 14461 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134848.622761:0:14482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14482:1873946312015616:0@lo:104: 00000100:00100000:3.0:1787134848.622824:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.623796:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312015616 00000100:00100000:0.0:1787134848.623807:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312015616 00000100:00100000:3.0:1787134848.623831:0:14482:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7f749b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787134848.623863:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787134848.623874:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:787f8101-2629-402b-af83-ff6c365f26f7+3:14482:x1873946312015616:12345-0@lo:104: 00010000:00010000:0.0:1787134848.623889:0:14450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624014:0:14450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787134848.624021:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:787f8101-2629-402b-af83-ff6c365f26f7+3:14482:x1873946312015616:12345-0@lo:104: Request processed in 150us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.624029:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787134848.624051:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134848.624057:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624066:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1787134848.624070:0:14456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624093:0:14456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787134848.624101:0:14456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134848.624107:0:14456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787134848.624147:0:14456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134848.624260:0:14482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14482:1873946312015616:0@lo:104: 00010000:00010000:3.0:1787134848.624280:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624385:0:14456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787134848.624450:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787134848.624469:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624476:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa81450200/0x69932dacae906e94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906e9b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624542:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134848.624544:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134848.624546:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134848.624634:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312015744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134848.624678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134848.624807:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312015744 00000100:00100000:0.0:1787134848.624812:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312015744 00010000:00010000:0.0:1787134848.624831:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906e94 expref: 13 pid: 14461 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134848.624891:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787134848.624899:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:787f8101-2629-402b-af83-ff6c365f26f7+13:3307:x1873946312015744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787134848.624910:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134848.624915:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906e94 expref: 13 pid: 14461 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624932:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae906e94 expref: 13 pid: 14461 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624946:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59deb600/0x69932dacae906e9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae906e94 expref: 13 pid: 14461 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624967:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.624975:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787134848.624989:0:14452:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002354186s 00010000:00010000:0.0:1787134848.624993:0:14452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.625001:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.625007:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.625013:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.625020:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134848.625024:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.625032:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.625053:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134848.625063:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134848.625094:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:787f8101-2629-402b-af83-ff6c365f26f7+12:3307:x1873946312015744:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134848.625101:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787134848.625365:0:14482:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.625373:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134848.625378:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea600/0x69932dacae906ecc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134848.625526:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312015744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787134848.629455:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+11:14449:x1873946312015488:12345-0@lo:253:mount.lustre.0 Request processed in 59967us (60029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134848.629470:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787134848.629477:0:14449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:14449:1873946312015488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787134848.629503:0:14449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787134848.629507:0:14449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787134848.629508:0:14449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787134848.629510:0:14449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134848.629511:0:14449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134848.629513:0:14449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134848.629514:0:14449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134848.629516:0:14449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787134848.629517:0:14449:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787134848.629519:0:14449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134848.629520:0:14449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787134848.629535:0:14449:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787134848.634328:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134848.634504:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134848.635327:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134848.635555:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134848.635838:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134848.636025:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134848.636867:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134848.637065:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134848.637457:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134848.637664:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787134848.638001:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787134848.638112:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787134848.659887:0:14449:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787134848.660755:0:14449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787134848.660819:0:14505:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787134848.660823:0:14505:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787134848.662383:0:14506:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787134848.662488:0:14506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787134848.668519:0:14449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787134848.668607:0:14449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787134848.669351:0:14506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787134848.669424:0:14506:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787134848.669427:0:14506:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1787134848.670482:0:14449:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787134848.670493:0:14449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787134848.670881:0:14449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134848.672444:0:14449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787134848.673542:0:14449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787134848.673714:0:14449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787134848.677090:0:14449:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787134848.682621:0:14449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787134848.737773:0:14449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787134848.737816:0:14449:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbeb4c1c63988 00100000:10000000:2.0:1787134848.737823:0:14449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787134848.739005:0:14449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787134848.739021:0:14449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787134848.739038:0:14449:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787134848.739067:0:14449:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787134849.344807:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787134849.472252:0:14463:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787134849.472275:0:14463:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98aa458e9800 from 6 10000000:01000000:1.0:1787134849.472280:0:14463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787134849.472324:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134849.472337:0:14463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134849.472347:0:14463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134849.472374:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312015872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787134849.472442:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134849.472499:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa455f8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134849.475487:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312015872 00000100:00100000:0.0:1787134849.475505:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312015872 00000100:00100000:0.0:1787134849.475580:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787134849.475591:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+11:14463:x1873946312015872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134849.475607:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134849.475626:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906ed3 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134849.475652:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906ed3 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134849.475679:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906ed3 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134849.475689:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451a00, rc 0) 00000100:00100000:0.0:1787134849.475780:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+12:14463:x1873946312015872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (3337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134849.475787:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787134849.476238:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312015872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787134849.476261:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134849.476283:0:14463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134849.476361:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312016000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787134849.476403:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134849.476441:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81538480 going to sleep for 11 seconds 00000100:00100000:1.0:1787134849.476443:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312016000 00000100:00100000:1.0:1787134849.476448:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312016000 00000100:00100000:1.0:1787134849.476493:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787134849.476501:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+12:14463:x1873946312016000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787134849.476516:0:14459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787134849.476533:0:14459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787134849.476537:0:14459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787134849.476614:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+12:14463:x1873946312016000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134849.476622:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787134849.476800:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312016000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787134849.476853:0:14463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787134849.476860:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134849.476869:0:14463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787134849.601922:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787134850.369187:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787134850.629519:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787134851.392326:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134852.416364:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134853.441320:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787134853.832264:0:14748:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787134854.039497:0:14019:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787134854.039514:0:14019:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787134854.039561:0:14019:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787134854.039565:0:14019:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787134854.039568:0:14019:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787134854.039571:0:14019:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787134854.039575:0:14019:0:(import.c:65:import_set_state_nolock()) ffff98aa52a7a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787134854.039586:0:14019:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98aa52a7a800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787134854.039611:0:14019:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa81e42d80 x1873946312016256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787134854.040199:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:787f8101-2629-402b-af83-ff6c365f26f7:3309:1873946312016128:0@lo:400:kworker.0 00000100:00100000:3.0:1787134854.040285:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134854.040672:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312016128 00000100:00100000:2.0:1787134854.040681:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312016128 00000100:00100000:2.0:1787134854.040733:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787134854.040743:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:3309:x1873946312016128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134854.040798:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:3309:x1873946312016128:12345-0@lo:400:kworker.0 Request processed in 57us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134854.040805:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787134854.047442:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:787f8101-2629-402b-af83-ff6c365f26f7:3309:1873946312016128:0@lo:400:kworker.0 00000100:00100000:1.0:1787134854.047655:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946312016256:0@lo:38:kworker.0 00000100:00100000:1.0:1787134854.047733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134854.047802:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312016256 00000100:00100000:1.0:1787134854.047808:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312016256 00000100:00100000:1.0:1787134854.047870:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787134854.047877:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1873946312016256:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787134854.047904:0:14468:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:1.0:1787134854.047948:0:14468:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x69932dacae906ee1 00000004:00100000:1.0:1787134854.047962:0:14468:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787134854.048104:0:14468:0:(import.c:65:import_set_state_nolock()) ffff98aa5407c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787134854.048152:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873946312016256:12345-0@lo:38:kworker.0 Request processed in 275us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134854.048192:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787134854.048223:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98aa81e42d80 x1873946312016256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787134864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787134854.048238:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787134854.048245:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787134854.048249:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787134854.048252:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa52a7a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787134854.048257:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873946312016256:0@lo:38:kworker.0 00010000:00010000:0.0:1787134854.468414:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134855.491560:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134856.512573:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787134857.194355:0:14899:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec5b581d0 20000000:00000080:3.0:1787134857.194376:0:14899:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98aa7d881800 uarg=0000000000000000 20000000:01000000:3.0:1787134857.194413:0:14899:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787134857.194421:0:14899:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787134857.194426:0:14899:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787134857.195455:0:14900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787134857.195618:0:14899:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787134857.204553:0:14899:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787134857.204679:0:14899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134857.204699:0:14899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906ea2 expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134857.204708:0:14899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134857.204762:0:14899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae906ea2 expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134857.204778:0:14899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae906ea2 expref: 11 pid: 14460 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134857.204793:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14899:1873946312016384:0@lo:104: 00000100:00100000:2.0:1787134857.205020:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134857.205548:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81538840 going to sleep for 11 seconds 00000100:00100000:1.0:1787134857.205653:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312016384 00000100:00100000:1.0:1787134857.205661:0:14451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312016384 00000100:00100000:1.0:1787134857.205745:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787134857.205755:0:14451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+3:14899:x1873946312016384:12345-0@lo:104: 00010000:00010000:1.0:1787134857.205781:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134857.205897:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787134857.205905:0:14451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+3:14899:x1873946312016384:12345-0@lo:104: Request processed in 152us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134857.205920:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787134857.206236:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14899:1873946312016384:0@lo:104: 00010000:00010000:2.0:1787134857.206257:0:14899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.206463:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134857.206471:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.206479:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134857.206484:0:14455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.206493:0:14455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134857.206507:0:14455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134857.206513:0:14455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787134857.206592:0:14455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.206600:0:14455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134857.206632:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.206640:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6200/0x69932dacae906ea2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906ea9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.206656:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134857.206658:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134857.206659:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134857.206667:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787134857.206679:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:787f8101-2629-402b-af83-ff6c365f26f7:3309:1873946312016512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787134857.206723:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134857.206967:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312016512 00000100:00100000:3.0:1787134857.206973:0:14453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312016512 00010000:00010000:3.0:1787134857.206996:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906ea2 expref: 12 pid: 14460 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134857.207018:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134857.207026:0:14453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:787f8101-2629-402b-af83-ff6c365f26f7+12:3309:x1873946312016512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134857.207108:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134857.207121:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906ea2 expref: 12 pid: 14460 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207133:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae906ea2 expref: 12 pid: 14460 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207148:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa96600/0x69932dacae906ea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae906ea2 expref: 12 pid: 14460 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207183:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207193:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207208:0:14453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207216:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207224:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207230:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207236:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134857.207241:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207248:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207270:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134857.207280:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134857.207311:0:14453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:787f8101-2629-402b-af83-ff6c365f26f7+11:3309:x1873946312016512:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134857.207318:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134857.207347:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:787f8101-2629-402b-af83-ff6c365f26f7:3309:1873946312016512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134857.207670:0:14899:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134857.207680:0:14899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134857.207686:0:14899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa97800/0x69932dacae906ee8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134857.536741:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134858.177933:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787134848/real 1787134848] req@ffff98a942206d80 x1873946312013568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787134858 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134858.177967:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98a942206d80 x1873946312013568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787134858 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134858.177978:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787134848/real 1787134848] req@ffff98a942205500 x1873946312013440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787134858 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134858.177990:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98a942205500 x1873946312013440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787134858 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787134858.178012:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa51547000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787134858.178035:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787134858.178039:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312013568:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787134858.178046:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa73ca9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787134858.178051:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787134858.178054:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312013440:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787134858.178294:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787134858.178299:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787134858.178302:0:475:0:(import.c:65:import_set_state_nolock()) ffff98aa73ca9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787134858.178308:0:475:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:2.0:1787134858.178315:0:475:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787134858.178323:0:475:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98aa73ca9800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787134858.178361:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa81e40700 x1873946312016768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787134858.178377:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787134858.178380:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787134858.178382:0:475:0:(import.c:65:import_set_state_nolock()) ffff98aa51547000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787134858.178385:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:2.0:1787134858.178387:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787134858.178391:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98aa51547000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787134858.178403:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa81e42d80 x1873946312016896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787134858.178438:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312017024:0@lo:400:kworker.0 00000100:00100000:2.0:1787134858.178509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134858.178573:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787134858.178581:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312016640:0@lo:400:kworker.0 00000100:00100000:2.0:1787134858.178610:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134858.178648:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312017024 00000100:00100000:2.0:1787134858.178657:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312017024 00000100:00100000:2.0:1787134858.178700:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134858.178710:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312017024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134858.178760:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312017024:12345-0@lo:400:kworker.0 Request processed in 51us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134858.178768:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134858.178795:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312016640 00000100:00100000:2.0:1787134858.178798:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312016640 00000100:00100000:2.0:1787134858.178826:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787134858.178832:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+11:3308:x1873946312016640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134858.178883:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+11:3308:x1873946312016640:12345-0@lo:400:kworker.0 Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134858.178890:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787134858.178924:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312016768:0@lo:8:kworker.0 00000400:00000100:2.0:1787134858.178944:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873946312016768 offset 0 length 520: 4 00000100:00100000:2.0:1787134858.178957:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312016896:0@lo:8:kworker.0 00000400:00000100:2.0:1787134858.178976:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873946312016896 offset 0 length 520: 4 00000100:00100000:2.0:1787134858.179008:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312016640:0@lo:400:kworker.0 00010000:00080000:2.0:1787134858.179021:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98aa81e41500 x1873946312017024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134858.179030:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312017024:0@lo:400:kworker.0 00010000:00010000:3.0:1787134858.560419:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787134859.137256:0:14463:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787134859.137266:0:14463:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa458e9800 from 10 10000000:01000000:2.0:1787134859.137272:0:14463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787134859.137320:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134859.137331:0:14463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134859.137343:0:14463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134859.137379:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312017152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787134859.137470:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134859.137532:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4571d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787134859.137587:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312017152 00000100:00100000:0.0:1787134859.137605:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312017152 00000100:00100000:0.0:1787134859.137660:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787134859.137670:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+11:14463:x1873946312017152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134859.137685:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134859.137700:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906eef expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134859.137722:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906eef expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134859.137732:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906eef expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134859.137741:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451000, rc 0) 00000100:00100000:0.0:1787134859.137801:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+12:14463:x1873946312017152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134859.137808:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787134859.137851:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312017152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134859.137894:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134859.137904:0:14463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134859.137959:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312017280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134859.137984:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134859.137998:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50bc9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787134859.138010:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312017280 00000100:00100000:0.0:1787134859.138014:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312017280 00000100:00100000:0.0:1787134859.138035:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787134859.138041:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:14463:x1873946312017280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134859.138302:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:14463:x1873946312017280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134859.138309:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787134859.138337:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312017280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134859.138361:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312017408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134859.138396:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134859.138407:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50bc9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787134859.138417:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312017408 00000100:00100000:0.0:1787134859.138421:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312017408 00000100:00100000:0.0:1787134859.138445:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787134859.138450:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:14463:x1873946312017408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134859.138581:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:14463:x1873946312017408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134859.138588:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787134859.138624:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312017408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787134859.150394:0:14965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787134859.152821:0:14463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787134859.152871:0:14463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787134859.152883:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134859.152895:0:14463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134859.585289:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134860.608723:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787134860.865694:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787134861.633602:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787134862.640799:0:15149:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787134862.640806:0:15149:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787134862.641000:0:15149:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98aa6aa84800 00000020:01000004:3.0:1787134862.641017:0:15149:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787134862.641028:0:15149:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787134862.641050:0:15149:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98aa464599c0) 00000020:00000080:3.0:1787134862.641067:0:15149:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787134862.663930:0:15149:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787134862.664275:0:15149:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00010000:00010000:2.0:1787134862.665526:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787134862.667392:0:15149:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787134862.667629:0:15149:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787134862.668927:0:15149:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787134862.671752:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 371: rc = 0 00100000:10000000:0.0:1787134862.671857:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 371: rc = 0 00100000:10000000:0.0:1787134862.672597:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 371: rc = 0 00100000:10000000:0.0:1787134862.673113:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:0.0:1787134862.674776:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:0.0:1787134862.676746:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:0.0:1787134862.677018:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:1.0:1787134862.678771:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:1.0:1787134862.679107:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00000020:00000080:1.0:1787134862.679972:0:15149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787134862.679985:0:15149:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787134862.679997:0:15149:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x69932dacae906f04 00000020:01000004:1.0:1787134862.680006:0:15149:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787134862.680028:0:15149:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.136@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787134862.680031:0:15149:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787134862.680036:0:15149:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787134862.680040:0:15149:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787134862.680051:0:15149:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98aa6aa48000) 00000020:00000080:1.0:1787134862.680060:0:15149:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1787134862.681637:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787134862.681843:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787134862.681849:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787134862.691595:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787134862.691609:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787134862.701426:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787134862.701448:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787134862.703587:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787134862.703804:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787134862.703811:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787134862.710678:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787134862.710697:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787134862.747489:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787134862.747745:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787134862.747751:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787134862.766402:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787134862.766420:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787134862.768152:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787134862.768493:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787134862.771686:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787134862.771864:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787134862.771873:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787134862.773066:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787134862.773077:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787134862.808583:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787134862.808816:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787134862.808823:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787134862.810553:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787134862.810569:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787134862.811042:0:15149:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787134862.811071:0:15149:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787134862.811079:0:15149:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787134862.821527:0:15149:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787134862.821576:0:15149:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.136@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787134862.821582:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787134862.821584:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787134862.821585:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134862.821587:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134862.821588:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134862.821589:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134862.821591:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787134862.821593:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134862.821594:0:15149:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787134862.821598:0:15149:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787134862.821601:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787134862.821602:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787134862.821603:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134862.821604:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134862.821605:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134862.821606:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134862.821607:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787134862.821613:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134862.821614:0:15149:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787134862.821647:0:15149:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787134862.821671:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312017536:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787134862.821745:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134862.821845:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa51339900 going to sleep for 11 seconds 00000100:00100000:0.0:1787134862.821908:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312017536 00000100:00100000:0.0:1787134862.821916:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312017536 00000100:00100000:0.0:1787134862.822002:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787134862.822013:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:15149:x1873946312017536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787134862.822052:0:14461:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787134862.822054:0:14461:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787134862.822059:0:14461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787134862.846588:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:15149:x1873946312017536:12345-0@lo:253:mount.lustre.0 Request processed in 24566us (24831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134862.846607:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787134862.846738:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312017536:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787134862.846756:0:15149:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787134862.846760:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787134862.846762:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787134862.846763:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134862.846764:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134862.846765:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134862.846767:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134862.846768:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787134862.846770:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134862.846771:0:15149:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787134862.846804:0:15149:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98aa6aa84800 from lustre-OST0000 10000000:01000000:0.0:1787134862.846843:0:15149:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787134862.846847:0:15149:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787134862.846854:0:15149:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98aa6ff58000 local copy 00010000:00010000:0.0:1787134862.846865:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134862.847122:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312017664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134862.847206:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134862.847645:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312017664 00000100:00100000:2.0:1787134862.847653:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312017664 00000100:00100000:2.0:1787134862.847712:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787134862.847722:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+12:15149:x1873946312017664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787134862.847922:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+12:15149:x1873946312017664:12345-0@lo:501:mount.lustre.0 Request processed in 200us (714us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787134862.847930:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787134862.851423:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81538840 going to sleep for 11 seconds 00000100:00100000:1.0:1787134862.851479:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312017664:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787134862.851510:0:15149:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787134862.853066:0:15149:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787134862.853079:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.853091:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134862.853124:0:15149:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98aa6aa84800 10000000:01000000:1.0:1787134862.853139:0:15149:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787134862.853146:0:15149:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98aa6ff58000 10000000:01000000:1.0:1787134862.853148:0:15149:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787134862.853152:0:15149:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98aa6ff58000 from 1 10000000:01000000:1.0:1787134862.853175:0:15149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787134862.853214:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6600/0x69932dacae906f12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.853222:0:15149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6600/0x69932dacae906f12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.853244:0:15149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6600/0x69932dacae906f12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134862.853330:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312017792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787134862.853393:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.853443:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4571d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787134862.853784:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312017792 00000100:00100000:2.0:1787134862.853791:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312017792 00000100:00100000:2.0:1787134862.853851:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787134862.853861:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+12:15149:x1873946312017792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787134862.853873:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134862.853897:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa97e00/0x69932dacae906f19 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906f12 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134862.853920:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa97e00/0x69932dacae906f19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906f12 expref: 13 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134862.853930:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa97e00/0x69932dacae906f19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906f12 expref: 13 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134862.853950:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97e00, rc 0) 00000100:00100000:2.0:1787134862.853999:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+13:15149:x1873946312017792:12345-0@lo:101:mount.lustre.0 Request processed in 140us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134862.854005:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787134862.854465:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312017792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787134862.854481:0:15149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6600/0x69932dacae906f12 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f19 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.854491:0:15149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6600/0x69932dacae906f12 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906f19 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134862.854510:0:15149:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787134862.854525:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6600/0x69932dacae906f12 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f19 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.854533:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6600/0x69932dacae906f12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f19 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134862.854554:0:15149:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787134862.854557:0:15149:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787134862.854564:0:15149:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787134862.854566:0:15149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787134862.854587:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6000/0x69932dacae906f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.854594:0:15149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6000/0x69932dacae906f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.854602:0:15149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6000/0x69932dacae906f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134862.854616:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312017920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787134862.854645:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.854674:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4571d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787134862.854741:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312017920 00000100:00100000:3.0:1787134862.854746:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312017920 00000100:00100000:3.0:1787134862.854788:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787134862.854795:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+13:15149:x1873946312017920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787134862.854808:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134862.854817:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa59dea600/0x69932dacae906f27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906f20 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134862.854858:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea600/0x69932dacae906f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906f20 expref: 14 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134862.854867:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa59dea600/0x69932dacae906f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906f20 expref: 14 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134862.854874:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa59dea600, rc 0) 00000100:00100000:3.0:1787134862.854913:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312017920:12345-0@lo:101:mount.lustre.0 Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134862.854919:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787134862.855515:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312017920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787134862.855529:0:15149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6000/0x69932dacae906f20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f27 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.855538:0:15149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6000/0x69932dacae906f20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906f27 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787134862.856726:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787134862.858577:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134862.861648:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787134862.861755:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787134862.861803:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787134862.866012:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787134862.866151:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787134862.866205:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787134862.866302:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787134862.866311:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787134862.866435:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134862.866517:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.866555:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4571d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787134862.866796:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312018048 00000100:00100000:0.0:1787134862.866806:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312018048 00000100:00100000:0.0:1787134862.866876:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787134862.866885:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312018048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134862.867397:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312018048:12345-0@lo:501:mount.lustre.0 Request processed in 511us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134862.867408:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787134862.867541:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134862.868310:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787134862.868381:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.868431:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4571d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787134862.868472:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312018176 00000100:00100000:2.0:1787134862.868480:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312018176 00000100:00100000:2.0:1787134862.868528:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787134862.868537:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312018176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787134862.872396:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312018176:12345-0@lo:503:mount.lustre.0 Request processed in 3856us (4010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134862.872413:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787134862.872515:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018176:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787134862.873506:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787134862.873587:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787134862.873667:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.873718:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4571d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787134862.878517:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312018304 00000100:00100000:0.0:1787134862.878535:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312018304 00000100:00100000:0.0:1787134862.878608:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787134862.878619:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312018304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787134862.879007:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312018304:12345-0@lo:502:mount.lustre.0 Request processed in 390us (5339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134862.879016:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787134862.879476:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787134862.879756:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787134862.879957:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787134862.879992:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787134862.880044:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787134862.880077:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787134862.880105:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787134862.880148:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787134862.880206:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787134862.880236:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787134862.880307:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787134862.880337:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787134862.880375:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787134862.880415:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787134862.880469:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.880501:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4571d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787134862.884450:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312018432 00000100:00100000:0.0:1787134862.884469:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312018432 00000100:00100000:0.0:1787134862.884546:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787134862.884558:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312018432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787134862.884867:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312018432:12345-0@lo:502:mount.lustre.0 Request processed in 310us (4396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134862.884875:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787134862.885205:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787134862.885512:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787134862.885530:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787134862.891577:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787134862.891593:0:15163:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787134862.891602:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134862.891604:0:15163:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787134862.891611:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787134862.891629:0:15163:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98aa438f3380) 00000020:00000080:0.0:1787134862.891660:0:15163:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787134862.891666:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787134862.891727:0:15163:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa6aa84800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787134862.891735:0:15163:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787134862.891743:0:15163:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x69932dacae906f35 00010000:00010000:1.0:1787134862.904606:0:15163:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787134862.906498:0:15163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787134862.912073:0:15163:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787134862.913501:0:15163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787134862.913513:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787134862.913520:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134862.913522:0:15163:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787134862.913526:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787134862.913528:0:15163:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787134862.913530:0:15163:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787134862.913531:0:15163:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787134862.913532:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787134862.913534:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134862.913536:0:15163:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787134862.913538:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787134862.913541:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134862.913542:0:15163:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787134862.913545:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787134862.913546:0:15163:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787134862.913548:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787134862.913550:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134862.913558:0:15163:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787134862.913562:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787134862.913564:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134862.913565:0:15163:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787134862.913568:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787134862.913628:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787134862.913631:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787134862.913633:0:15163:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787134862.913635:0:15163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787134862.916406:0:15149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787134862.916447:0:15149:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787134862.916466:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6000/0x69932dacae906f20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f27 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.916480:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6000/0x69932dacae906f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f27 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787134862.916487:0:15149:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa6aa84800 from 1 10000000:01000000:1.0:1787134862.916490:0:15149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787134862.916529:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.916536:0:15149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.916547:0:15149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134862.916591:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787134862.916668:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.916709:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4571d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787134862.918490:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312018560 00000100:00100000:0.0:1787134862.918505:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312018560 00000100:00100000:0.0:1787134862.918617:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787134862.918629:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+14:15149:x1873946312018560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787134862.918654:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134862.918677:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906f3c expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134862.918706:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906f3c expref: 15 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134862.918718:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906f3c expref: 15 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134862.918738:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451800, rc 0) 00000100:00100000:0.0:1787134862.918815:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312018560:12345-0@lo:101:mount.lustre.0 Request processed in 188us (2146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134862.918822:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787134862.923680:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787134862.923716:0:15149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.923745:0:15149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787134862.925062:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787134862.925949:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134862.928058:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787134862.928178:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787134862.928271:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787134862.928280:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787134862.928390:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134862.928476:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.928523:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4571d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787134862.929659:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312018688 00000100:00100000:3.0:1787134862.929670:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312018688 00000100:00100000:3.0:1787134862.929728:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787134862.929738:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312018688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787134862.930016:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312018688:12345-0@lo:501:mount.lustre.0 Request processed in 279us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134862.930023:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787134862.931056:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134862.931101:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787134862.931149:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.931272:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787134862.931542:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312018816 00000100:00100000:0.0:1787134862.931548:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312018816 00000100:00100000:0.0:1787134862.931584:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787134862.931592:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312018816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787134862.931747:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312018816:12345-0@lo:503:mount.lustre.0 Request processed in 156us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134862.931754:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787134862.932091:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018816:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787134862.932845:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787134862.933010:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787134862.933067:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.933452:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f6540 going to sleep for 11 seconds 00000100:00100000:2.0:1787134862.933617:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312018944 00000100:00100000:2.0:1787134862.933624:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312018944 00000100:00100000:2.0:1787134862.933671:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787134862.933679:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312018944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787134862.934275:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312018944:12345-0@lo:502:mount.lustre.0 Request processed in 595us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134862.934285:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787134862.934308:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312018944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787134862.934742:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787134862.934866:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787134862.934930:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787134862.935008:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787134862.935042:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787134862.935084:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787134862.935117:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787134862.935148:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787134862.935470:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787134862.935526:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.935560:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f6540 going to sleep for 11 seconds 00000100:00100000:2.0:1787134862.935574:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312019072 00000100:00100000:2.0:1787134862.935582:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312019072 00000100:00100000:2.0:1787134862.935629:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787134862.935638:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312019072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787134862.940329:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312019072:12345-0@lo:502:mount.lustre.0 Request processed in 4679us (4790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134862.940346:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787134862.940378:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787134862.941388:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787134862.941412:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787134862.953030:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134862.953046:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134862.953049:0:15167:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787134862.953055:0:15167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa6aa84800 00000020:00000080:1.0:1787134862.953057:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787134862.953065:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134862.953067:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134862.953069:0:15167:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787134862.953071:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134862.953073:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134862.953075:0:15167:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787134862.953078:0:15167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa6aa84800 00000020:00000080:1.0:1787134862.953101:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787134862.953208:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134862.953213:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134862.953214:0:15167:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787134862.953217:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787134862.953220:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134862.953221:0:15167:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787134862.953224:0:15167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98aa6aa84800 00000020:00000080:1.0:1787134862.953226:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787134862.953276:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787134862.953280:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134862.953282:0:15167:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787134862.953284:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787134862.953516:0:15149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787134862.953546:0:15149:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787134862.953570:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134862.953584:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787134862.953647:0:15149:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787134862.953650:0:15149:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98aa6aa84800 10000000:01000000:0.0:1787134862.953653:0:15149:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98aa6aa84800 10000000:01000000:0.0:1787134862.953658:0:15149:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787134862.953664:0:15149:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa6aa84800 from 1 10000000:01000000:0.0:1787134862.953667:0:15149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787134862.953704:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450c00/0x69932dacae906f4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134862.953714:0:15149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa81450c00/0x69932dacae906f4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134862.953726:0:15149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa81450c00/0x69932dacae906f4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134862.953752:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787134862.953839:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134862.953887:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54b7fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787134862.954001:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312019200 00000100:00100000:2.0:1787134862.954009:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312019200 00000100:00100000:2.0:1787134862.954061:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787134862.954071:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312019200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787134862.954084:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134862.954098:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa97c00/0x69932dacae906f51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906f4a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134862.954132:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa97c00/0x69932dacae906f51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906f4a expref: 16 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134862.954143:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa97c00/0x69932dacae906f51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906f4a expref: 16 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134862.954153:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97c00, rc 0) 00000100:00100000:2.0:1787134862.954233:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312019200:12345-0@lo:101:mount.lustre.0 Request processed in 163us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134862.954239:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787134862.954328:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787134862.954343:0:15149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa81450c00/0x69932dacae906f4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f51 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134862.954353:0:15149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa81450c00/0x69932dacae906f4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906f51 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787134862.955140:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787134862.956487:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787134862.964625:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787134862.964733:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787134862.964763:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787134862.965368:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787134862.965404:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787134862.965445:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787134862.965475:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787134862.965501:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787134862.965558:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787134862.965648:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787134862.965692:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787134862.965743:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787134862.965772:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787134862.966364:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787134862.966416:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787134862.966448:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787134862.966482:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787134862.966524:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787134862.966554:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787134862.966583:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787134862.968091:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787134862.968138:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787134862.968186:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787134862.969331:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787134862.969438:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787134862.969471:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787134862.969525:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787134862.969559:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787134862.969659:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787134862.969666:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787134862.973372:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134862.973472:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134862.973520:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa54b7f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134862.984260:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312019328 00000100:00100000:2.0:1787134862.984277:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312019328 00000100:00100000:2.0:1787134862.984402:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787134862.984422:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312019328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787134862.984981:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312019328:12345-0@lo:501:mount.lustre.0 Request processed in 569us (11507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134862.984991:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787134862.985341:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134862.985408:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787134862.985466:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.985498:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787134862.985667:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312019456 00000100:00100000:0.0:1787134862.985673:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312019456 00000100:00100000:0.0:1787134862.985707:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787134862.985715:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312019456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787134862.986114:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312019456:12345-0@lo:503:mount.lustre.0 Request processed in 399us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134862.986122:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787134862.988046:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787134862.988690:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787134862.988768:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787134862.988854:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134862.988897:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787134862.990025:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312019584 00000100:00100000:0.0:1787134862.990043:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312019584 00000100:00100000:0.0:1787134862.990095:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787134862.990106:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312019584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787134862.990412:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312019584:12345-0@lo:502:mount.lustre.0 Request processed in 307us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134862.990421:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787134862.990686:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787134862.993407:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787134862.993517:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787134862.993559:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787134863.000288:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787134863.000416:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787134863.001069:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787134863.001113:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787134863.001143:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787134863.049411:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787134863.049886:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787134863.049924:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787134863.049982:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787134863.050028:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787134863.050076:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787134863.050152:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787134863.050389:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787134863.050424:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787134863.050610:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787134863.050656:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787134863.050698:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787134863.050756:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787134863.050803:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787134863.050860:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787134863.050916:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787134863.050944:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787134863.050993:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787134863.051053:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787134863.051095:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787134863.051129:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787134863.051735:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787134863.052636:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787134863.052690:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787134863.052729:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787134863.052881:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787134863.052921:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787134863.052972:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787134863.053011:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787134863.053059:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787134863.053109:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787134863.053146:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787134863.053232:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787134863.053319:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134863.053377:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50e466c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134863.055094:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312019712 00000100:00100000:1.0:1787134863.055107:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312019712 00000100:00100000:1.0:1787134863.055182:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787134863.055194:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312019712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787134863.055510:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312019712:12345-0@lo:502:mount.lustre.0 Request processed in 318us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134863.055518:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787134863.056903:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312019712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787134863.057064:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787134863.057080:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787134863.063229:0:15172:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787134863.063256:0:15172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98aa6aa4cd40) 00000020:00000080:1.0:1787134863.063280:0:15172:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787134863.063456:0:15172:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa6aa84800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787134863.063460:0:15172:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98aa6aa84800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787134863.063463:0:15172:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa6aa84800 3 00010000:00080000:1.0:1787134863.063494:0:15172:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa45765800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.136@tcp at head 00010000:00010000:1.0:1787134863.065149:0:15172:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787134863.065309:0:15172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787134863.065347:0:15172:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787134863.065360:0:15172:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x69932dacae906f5f 00000100:00080000:1.0:1787134863.065372:0:15172:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787134863.065378:0:15172:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98aa45765800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787134863.065422:0:15172:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a942206680 x1873946312019840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787134863.065462:0:15172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787134863.066733:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1873946312019840:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787134863.066818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787134863.066907:0:14019:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787134863.066913:0:14019:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787134863.066916:0:14019:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787134863.066919:0:14019:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787134863.068130:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134863.068150:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312019968:0@lo:400:kworker.0 00000100:00100000:0.0:1787134863.068226:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134863.068303:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312019840 00000100:00100000:0.0:1787134863.068311:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312019840 00000100:00100000:0.0:1787134863.068342:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312019968 00000100:00100000:0.0:1787134863.068345:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312019968 00000100:00100000:0.0:1787134863.068379:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787134863.068388:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312019968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134863.068448:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312019968:12345-0@lo:400:kworker.0 Request processed in 61us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134863.068456:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787134863.068474:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787134863.068479:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1873946312019840:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787134863.068501:0:14466:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1787134863.068545:0:14466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x69932dacae906f66 00000004:00100000:0.0:1787134863.068576:0:14466:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787134863.068612:0:14466:0:(import.c:65:import_set_state_nolock()) ffff98aa6ec5c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787134863.068657:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873946312019840:12345-0@lo:38:llog_process_th.0 Request processed in 176us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134863.068665:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787134863.068711:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98aa81e41f80 x1873946312019968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134863.068726:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312019968:0@lo:400:kworker.0 00010000:00080000:0.0:1787134863.068760:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98a942206680 x1873946312019840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787134873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134863.068770:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787134863.068775:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787134863.068782:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787134863.068787:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787134863.068789:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa45765800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787134863.068794:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1873946312019840:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787134863.071973:0:15172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787134863.072633:0:15149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787134863.072670:0:15149:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787134863.072690:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450c00/0x69932dacae906f4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f51 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.072703:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa81450c00/0x69932dacae906f4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f51 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787134863.072776:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787134863.072779:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787134863.072781:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134863.072782:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134863.072783:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134863.072785:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134863.072786:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787134863.072788:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134863.072790:0:15149:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787134863.072793:0:15149:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787134863.072796:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787134863.072798:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787134863.072799:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134863.072800:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134863.072801:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134863.072803:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134863.072804:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787134863.072805:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134863.072806:0:15149:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787134863.072847:0:15149:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787134863.072869:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312020096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787134863.072948:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134863.072983:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312020096 00000100:00100000:0.0:1787134863.072992:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312020096 00000100:00100000:2.0:1787134863.072999:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50886240 going to sleep for 11 seconds 00000100:00100000:0.0:1787134863.073034:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787134863.073042:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+16:15149:x1873946312020096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787134863.073066:0:14460:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787134863.073079:0:14460:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787134863.141006:0:14460:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787134863.141033:0:14460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787134863.141264:0:14482:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787134863.141270:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787134863.141291:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134863.141313:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906ed3 expref: 16 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134863.141322:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134863.141373:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae906ed3 expref: 16 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134863.141387:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae906ed3 expref: 16 pid: 14460 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134863.141402:0:14482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14482:1873946312020224:0@lo:104: 00000100:00100000:3.0:1787134863.141468:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134863.141516:0:14482:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa50e46240 going to sleep for 11 seconds 00000100:00100000:1.0:1787134863.141670:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312020224 00000100:00100000:1.0:1787134863.141679:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312020224 00000100:00100000:1.0:1787134863.141729:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787134863.141739:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:787f8101-2629-402b-af83-ff6c365f26f7+3:14482:x1873946312020224:12345-0@lo:104: 00010000:00010000:1.0:1787134863.141752:0:14450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134863.141818:0:14450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787134863.141835:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:787f8101-2629-402b-af83-ff6c365f26f7+3:14482:x1873946312020224:12345-0@lo:104: Request processed in 97us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134863.141843:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787134863.142124:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134863.142132:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142141:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7a00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1787134863.142146:0:14456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142155:0:14456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134863.142218:0:14456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134863.142224:0:14456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787134863.142243:0:14482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14482:1873946312020224:0@lo:104: 00010000:00010000:2.0:1787134863.142253:0:14456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142259:0:14456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134863.142270:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142277:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142283:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe7a00/0x69932dacae906ed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906eda expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134863.142287:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787134863.142299:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:787f8101-2629-402b-af83-ff6c365f26f7:3309:1873946312020352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134863.142299:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134863.142301:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134863.142302:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134863.142329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134863.142676:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312020352 00000100:00100000:2.0:1787134863.142681:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312020352 00010000:00010000:2.0:1787134863.142701:0:14454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906ed3 expref: 17 pid: 14460 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134863.142731:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787134863.142739:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:787f8101-2629-402b-af83-ff6c365f26f7+17:3309:x1873946312020352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134863.142750:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134863.142754:0:14454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906ed3 expref: 17 pid: 14460 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142765:0:14454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae906ed3 expref: 17 pid: 14460 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142796:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa81451a00/0x69932dacae906eda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae906ed3 expref: 17 pid: 14460 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142810:0:14454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142817:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787134863.142841:0:14454:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002354186s 00010000:00010000:2.0:1787134863.142845:0:14454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142853:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142859:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142865:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142870:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134863.142875:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142883:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142895:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134863.142910:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134863.142946:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:787f8101-2629-402b-af83-ff6c365f26f7+16:3309:x1873946312020352:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134863.142953:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787134863.143392:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:787f8101-2629-402b-af83-ff6c365f26f7:3309:1873946312020352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134863.143418:0:14482:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134863.143425:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134863.143431:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa59dea400/0x69932dacae906f6d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134863.163530:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+15:15149:x1873946312020096:12345-0@lo:253:mount.lustre.0 Request processed in 90478us (90571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134863.163549:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787134863.163649:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15149:1873946312020096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787134863.163667:0:15149:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787134863.163671:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787134863.163672:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787134863.163674:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787134863.163675:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787134863.163676:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787134863.163678:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787134863.163680:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787134863.163682:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787134863.163683:0:15149:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787134863.163700:0:15149:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787134863.171715:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787134863.172326:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787134863.172504:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787134863.172665:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787134863.173357:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787134863.173604:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787134863.175735:0:15149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787134863.263551:0:15149:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787134863.263561:0:15149:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787134863.263597:0:15149:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787134863.263660:0:15149:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787134863.263678:0:15149:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787134863.263709:0:15149:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787134863.680435:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787134864.398599:0:14463:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787134864.398608:0:14463:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98aa458e9800 from 7 10000000:01000000:2.0:1787134864.398614:0:14463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787134864.398668:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134864.398681:0:14463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134864.398692:0:14463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134864.398721:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312020480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787134864.398799:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134864.404202:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa524eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134864.406737:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312020480 00000100:00100000:0.0:1787134864.406754:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312020480 00000100:00100000:0.0:1787134864.406833:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787134864.406844:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+15:14463:x1873946312020480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134864.406878:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134864.406899:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae906f74 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134864.406927:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae906f74 expref: 16 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134864.406938:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906f74 expref: 16 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134864.406947:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450200, rc 0) 00000100:00100000:0.0:1787134864.407026:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:14463:x1873946312020480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (8227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134864.407033:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787134864.407188:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312020480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787134864.407209:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134864.407218:0:14463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134864.407298:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312020608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787134864.407337:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134864.407376:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa524eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134864.407723:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312020608 00000100:00100000:0.0:1787134864.407728:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312020608 00000100:00100000:0.0:1787134864.407751:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787134864.407758:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+16:14463:x1873946312020608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787134864.407773:0:14460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787134864.407790:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787134864.407793:0:14460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787134864.407892:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+16:14463:x1873946312020608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134864.407899:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787134864.407971:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312020608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787134864.408040:0:14463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787134864.408049:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134864.408067:0:14463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134864.704458:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134865.729078:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134866.753085:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134867.779358:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787134868.353451:0:14019:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787134868.353458:0:14019:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787134868.353461:0:14019:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787134868.353464:0:14019:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787134868.353494:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312020864:0@lo:400:kworker.0 00000100:00100000:2.0:1787134868.353570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134868.353645:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787134868.353651:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312020736:0@lo:400:kworker.0 00000100:00100000:2.0:1787134868.353679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134868.353712:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312020736 00000100:00100000:2.0:1787134868.353719:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312020736 00000100:00100000:2.0:1787134868.353762:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787134868.353771:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:3308:x1873946312020736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134868.353808:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787134868.353818:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312020992:0@lo:400:kworker.0 00000100:00100000:2.0:1787134868.353836:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:3308:x1873946312020736:12345-0@lo:400:kworker.0 Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134868.353843:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134868.353844:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787134868.353871:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312020864 00000100:00100000:0.0:1787134868.353881:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312020864 00000100:00100000:2.0:1787134868.353890:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312020736:0@lo:400:kworker.0 00000100:00100000:0.0:1787134868.353908:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312020992 00000100:00100000:0.0:1787134868.353910:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312020992 00000100:00100000:0.0:1787134868.353934:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787134868.353940:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312020864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134868.354043:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312020864:12345-0@lo:400:kworker.0 Request processed in 103us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134868.354050:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787134868.354090:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134868.354097:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312020992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134868.354156:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312020992:12345-0@lo:400:kworker.0 Request processed in 59us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134868.354195:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787134868.354203:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787134868.354239:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98a942204a80 x1873946312020992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134868.354251:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312020992:0@lo:400:kworker.0 00010000:00080000:2.0:1787134868.354942:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98a942205f80 x1873946312020864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787134868.354961:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312020864:0@lo:400:kworker.0 00010000:00010000:1.0:1787134868.805929:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134869.826409:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787134870.089570:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787134870.852343:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787134870.879698:0:15517:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787134871.875232:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134872.899015:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134873.344255:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787134858/real 1787134858] req@ffff98aa81e40700 x1873946312016768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787134873 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134873.344294:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98aa81e40700 x1873946312016768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787134873 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134873.344305:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787134858/real 1787134858] req@ffff98aa81e42d80 x1873946312016896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787134873 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134873.344316:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98aa81e42d80 x1873946312016896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787134873 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787134873.344361:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa73ca9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787134873.344444:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787134873.344449:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312016768:0@lo:8:kworker.0 00000100:00080000:0.0:1787134873.344456:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa51547000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787134873.344608:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:787f8101-2629-402b-af83-ff6c365f26f7:3310:1873946312021120:0@lo:400:kworker.0 00000100:00100000:1.0:1787134873.344687:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134873.344762:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312021120 00000100:00100000:3.0:1787134873.344772:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312021120 00000100:00080000:0.0:1787134873.344791:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787134873.344795:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312016896:0@lo:8:kworker.0 00000100:00100000:3.0:1787134873.344821:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787134873.344831:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:3310:x1873946312021120:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787134873.344899:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787134873.344904:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787134873.344906:0:475:0:(import.c:65:import_set_state_nolock()) ffff98aa73ca9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787134873.344911:0:475:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1787134873.344915:0:475:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787134873.344920:0:475:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98aa73ca9800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787134873.345558:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa81e40e00 x1873946312021248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787134873.345574:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787134873.345578:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787134873.345580:0:475:0:(import.c:65:import_set_state_nolock()) ffff98aa51547000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787134873.345584:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1787134873.345587:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787134873.345591:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98aa51547000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787134873.345602:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa81e41880 x1873946312021376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787134873.345670:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312021632:0@lo:400:kworker.0 00000100:00100000:2.0:1787134873.345721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134873.345768:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787134873.345774:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312021504:0@lo:400:kworker.0 00000100:00100000:2.0:1787134873.345812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134873.346228:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312021632 00000100:00100000:0.0:1787134873.346235:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312021632 00000100:00100000:0.0:1787134873.346294:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312021504 00000100:00100000:0.0:1787134873.346297:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312021504 00000100:00100000:0.0:1787134873.346317:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134873.346325:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312021632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134873.346377:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312021632:12345-0@lo:400:kworker.0 Request processed in 53us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134873.346385:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787134873.346403:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787134873.346410:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312021504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134873.346437:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312021504:12345-0@lo:400:kworker.0 Request processed in 28us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134873.346443:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787134873.346493:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa81e40a80 x1873946312021504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134873.346507:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312021504:0@lo:400:kworker.0 00010000:00080000:0.0:1787134873.346519:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa81e43800 x1873946312021632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134873.346537:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312021632:0@lo:400:kworker.0 00000100:00100000:0.0:1787134873.346563:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312021248:0@lo:8:kworker.0 00000100:00100000:0.0:1787134873.346596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134873.346623:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312021376:0@lo:8:kworker.0 00000100:00100000:0.0:1787134873.346647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134873.346717:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312021248 00000100:00100000:0.0:1787134873.346721:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312021248 00000100:00100000:0.0:1787134873.346750:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312021376 00000100:00100000:0.0:1787134873.347228:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312021376 00000100:00100000:0.0:1787134873.347253:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787134873.347259:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1873946312021248:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787134873.347286:0:15150:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1787134873.347318:0:15150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae906f82 00002000:00100000:0.0:1787134873.347334:0:15150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98aa6ec5a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211390b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787134873.347338:0:15150:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787134873.347341:0:15150:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787134873.348057:0:15150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787134873.348085:0:15150:0:(import.c:65:import_set_state_nolock()) ffff98aa6ec5e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787134873.348191:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1873946312021248:12345-0@lo:8:kworker.0 Request processed in 931us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134873.348201:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787134873.348223:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787134873.348228:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1873946312021376:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787134873.348240:0:15150:0:(ldlm_lib.c:1195:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787134873.348283:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1873946312021376:12345-0@lo:8:kworker.0 Request processed in 53us (1634us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787134873.348289:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787134873.348332:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa81e40e00 x1873946312021248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787134893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134873.348342:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787134873.348350:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787134873.348357:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787134873.348362:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787134873.348365:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa73ca9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787134873.348421:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1787134873.348488:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787134873.348494:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312021248:0@lo:8:kworker.0 00000100:00080000:0.0:1787134873.348508:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa51547000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787134873.348512:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787134873.348515:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312021376:0@lo:8:kworker.0 00000004:00080000:0.0:1787134873.348556:0:14488:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787134873.348999:0:14488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 489315839210ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787134873.349521:0:14489:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787134873.349546:0:14489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14489:1873946312021888:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787134873.349592:0:14489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134873.349618:0:14489:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa62035540 going to sleep for 11 seconds 00000100:00100000:2.0:1787134873.349932:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312021888 00000100:00100000:2.0:1787134873.349957:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312021888 00000100:00100000:2.0:1787134873.350007:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787134873.350017:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14489:x1873946312021888:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787134873.352190:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:3310:x1873946312021120:12345-0@lo:400:kworker.0 Request processed in 7350us (7501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134873.352204:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787134873.357051:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312021760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134873.357142:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134873.357295:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312021760 00000100:00100000:3.0:1787134873.357305:0:15154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312021760 00000100:00100000:3.0:1787134873.357353:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787134873.357362:0:15154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312021760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134873.357398:0:15154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134873.357448:0:15154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312021760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134873.357455:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787134873.359307:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:787f8101-2629-402b-af83-ff6c365f26f7:3310:1873946312021120:0@lo:400:kworker.0 00010000:00080000:1.0:1787134873.359414:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa81e40700 x1873946312021760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134873.359435:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312021760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787134873.359663:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787134873.370724:0:15150:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787134873.370745:0:15150:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787134873.370751:0:15150:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1787134873.384104:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134873.384116:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384132:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=489s v=(0 0) 00010000:00010000:2.0:1787134873.384136:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134873.384251:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384274:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384285:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384301:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384568:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134873.384581:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.384586:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384594:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.384599:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384608:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384626:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384634:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f74177f0/0x69932dacae906f89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.384652:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.384654:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.384656:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787134873.385422:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134873.385439:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385450:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=489s v=(0 0) 00010000:00010000:2.0:1787134873.385454:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134873.385459:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385469:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385479:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385487:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385504:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134873.385515:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.385519:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385527:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96a00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.385530:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385538:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385555:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385563:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b49f53c/0x69932dacae906f90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.385577:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.385578:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.385580:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787134873.386536:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134873.386546:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.386558:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=489s v=(0 0) 00010000:00010000:2.0:1787134873.386562:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134873.386566:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.386575:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.386584:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.386591:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.386629:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134873.387352:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134873.387362:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.387372:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134873.387376:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.387391:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.387411:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.387419:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096582113/0x69932dacae906f97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.387438:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.387440:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.387442:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787134873.390415:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134873.390431:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.390451:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=489s v=(0 0) 00010000:00010000:2.0:1787134873.390456:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134873.390462:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.390967:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.390981:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.390988:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.391010:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134873.391100:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.391107:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.391114:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.391127:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.391135:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787134873.393822:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.393837:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.393853:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.393858:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.393865:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.393880:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.393891:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.393906:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.393928:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134873.393943:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.394122:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394134:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd70b5cb/0x69932dacae906f9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394282:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.394285:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.394287:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.394427:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.394433:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394442:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.394447:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787134873.394454:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134873.394457:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.394461:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.394474:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.394476:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.394480:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.394489:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.394496:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.394503:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.394515:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134873.394528:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394543:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae906fa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394557:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.394560:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394566:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.394568:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394576:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394586:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394592:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae906fac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.394601:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.394603:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.394604:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.394609:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.394612:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.394613:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.395237:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.395248:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395326:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.395331:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.395335:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395344:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395353:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395360:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395376:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134873.395387:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134873.395391:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395397:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deba00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134873.395401:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395408:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395426:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395433:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae906fb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.395447:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.395449:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.395451:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.396335:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.396344:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.396355:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.396358:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.396363:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.396372:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.396381:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.396388:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.396422:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134873.396532:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.396539:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.396552:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.396556:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.396564:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.396576:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.396584:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae906fba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.396598:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.396600:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.396601:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.398457:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.398469:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.398483:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.398488:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.398494:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.398506:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.398516:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.398524:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.398540:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787134873.399332:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.399340:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.399350:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.399360:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.399364:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.399374:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400072:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400081:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400103:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787134873.400117:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787134873.400124:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400130:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134873.400134:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400143:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400192:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400211:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae906fc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400229:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134873.400232:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400237:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134873.400240:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400246:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400256:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400263:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae906fc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.400272:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.400274:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.400275:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134873.401278:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.401999:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.402009:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.402031:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.402035:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.402041:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.402056:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.402066:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.402074:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.402177:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787134873.402767:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.402775:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.402784:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.402789:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.402793:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.402804:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.402824:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.402832:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403832:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787134873.403843:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403854:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deaa00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134873.403859:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403868:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403892:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403900:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae906fcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403947:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134873.403958:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403965:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deae00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134873.403968:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403977:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403988:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.403997:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134873.403998:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134873.404001:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.404095:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787134873.404103:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae906fd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.404125:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.407400:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.407420:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.407444:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.407450:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.407458:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.407475:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.407486:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.407507:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.407886:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787134873.408365:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.408372:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.408382:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.408385:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.408390:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.408400:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.408409:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.408415:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.408971:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787134873.408980:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.408990:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59debe00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134873.408994:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.409003:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.409021:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.409035:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076f0fa7c/0x69932dacae906fdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.409053:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134873.409057:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.409063:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134873.409066:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.409073:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.409082:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.409089:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134873.409091:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134873.409093:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.409173:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787134873.409179:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a0f34bc/0x69932dacae906fe4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.409864:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.410085:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.410093:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410104:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.410108:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.410113:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410125:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410134:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410141:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410225:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134873.410236:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134873.410241:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410248:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deac00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134873.410252:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410268:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410284:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410292:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbfa36dc/0x69932dacae906feb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.410309:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.410311:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.410313:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.411076:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.411083:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.411094:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.411098:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.411103:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.411112:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.411122:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.411136:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.411154:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134873.412675:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.412688:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.412700:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.412705:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.412738:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.412759:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.412769:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.412771:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.412772:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.412858:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0c93c7f/0x69932dacae906ff2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787134873.414037:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.414047:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.414061:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.414066:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.414071:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.414083:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.414092:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.414100:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.414130:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787134873.414599:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134873.414608:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.414617:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59debc00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134873.414627:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.414637:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.414653:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.414659:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c383d3/0x69932dacae906ff9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.414684:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134873.414686:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134873.414688:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.414973:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.414980:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.414989:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.414992:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.414996:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.415006:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.415015:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.415023:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.415339:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787134873.417231:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.417246:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.417264:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.417276:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.417283:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.417297:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.417307:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.417314:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.417754:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787134873.417764:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.417774:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.417779:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.417788:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.417808:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.417815:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7c1216c/0x69932dacae907000 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.418047:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787134873.418098:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134873.418106:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.418114:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deba00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134873.418119:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.418127:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.418139:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.418188:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca3af6b5/0x69932dacae907007 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134873.418206:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134873.418209:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134873.418211:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.418833:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.418838:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.418840:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.418879:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.418888:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.418899:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.418904:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.418909:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.418921:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.418930:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.418945:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.419010:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787134873.419451:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.419457:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.419467:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.419470:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.419475:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.419484:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.419493:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.419499:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419581:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787134873.419588:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419595:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.419599:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419608:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419634:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419641:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000272ee064/0x69932dacae90700e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419666:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.419670:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419676:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59dea400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.419685:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419693:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419713:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.419723:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.419725:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.419737:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.420049:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787134873.420056:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000360bb9bb/0x69932dacae907015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787134873.420818:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.420828:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.420840:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.420844:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.420848:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.420858:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.420868:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.420876:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.421047:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.421055:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.421062:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.421065:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.421074:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.421089:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.421097:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.421108:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.421109:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.421287:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787134873.421294:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f83b26e/0x69932dacae90701c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.421810:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.422110:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.422118:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.422138:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.422143:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.422148:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.422245:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.422258:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.422266:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.422314:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134873.422785:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.422792:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.422800:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deae00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.422805:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.422814:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.422830:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.422837:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e31745ca/0x69932dacae907023 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.422856:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.422858:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.422860:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134873.423113:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.423120:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.423128:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.423132:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.423137:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.423147:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.423236:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.423244:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.423295:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787134873.423742:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.423748:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.423758:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.423761:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.423766:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.423774:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.423782:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.423790:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424058:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787134873.424065:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424073:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.424084:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424092:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424106:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424113:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b94a8fb/0x69932dacae90702a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424131:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.424135:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424142:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deb000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.424145:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424152:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424202:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.424210:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.424217:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.424219:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.424287:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787134873.424293:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047b7613b/0x69932dacae907031 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787134873.424920:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.424926:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.424937:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.424941:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.424945:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.424955:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.424963:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.424971:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.425001:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.425007:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.425014:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa59deaa00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.425018:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.425025:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.425037:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.425044:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.425046:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.425048:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.425111:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787134873.425116:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000679ff4a6/0x69932dacae907038 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.425198:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787134873.425237:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787134873.427038:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.427051:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.427065:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.427069:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.427075:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.427088:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.427099:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.427107:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.427205:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787134873.427764:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134873.427770:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.427779:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1787134873.427782:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134873.427793:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.427803:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.427812:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134873.427819:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428091:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787134873.428099:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428106:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7be00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.428111:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428129:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428147:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428154:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000512c5b0e/0x69932dacae90703f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428185:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134873.428189:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428196:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7aa00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134873.428200:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428207:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428215:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428222:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.428224:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134873.428230:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134873.428356:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787134873.428362:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6a3dc93/0x69932dacae907046 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134873.428754:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787134873.428833:0:15150:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1787134873.428973:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14489:x1873946312021888:12345-0@lo:5:osp-pre-0-0.0 Request processed in 78955us (79376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134873.428988:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787134873.429068:0:14489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14489:1873946312021888:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787134873.429084:0:14489:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787134873.429132:0:14489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14489:1873946312022016:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787134873.429241:0:14489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134873.429329:0:14489:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa43427d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787134873.430881:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312022016 00000100:00100000:1.0:1787134873.430896:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312022016 00000100:00100000:1.0:1787134873.430949:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787134873.430956:0:15152:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787134873.430960:0:15153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14489:x1873946312022016:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787134873.430964:0:15152:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:1.0:1787134873.431013:0:15153:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1787134873.444543:0:15153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14489:x1873946312022016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13578us (15294us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787134873.444557:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787134873.444864:0:14489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14489:1873946312022016:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787134873.444884:0:14489:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:3.0:1787134873.556271:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787134873.556369:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1787134873.920363:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134874.944571:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134875.974722:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134876.994705:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134878.016361:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787134878.564622:0:15870:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787134878.564627:0:15870:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787134878.564836:0:15870:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98aa6ec5a800 00000020:01000004:0.0:1787134878.564853:0:15870:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787134878.564865:0:15870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787134878.564877:0:15870:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98aa438f19c0) 00000020:00000080:0.0:1787134878.564896:0:15870:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787134878.586200:0:15870:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787134878.586490:0:15870:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787134878.587319:0:15870:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787134878.587554:0:15870:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787134878.588492:0:15870:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787134878.588933:0:15870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 525: rc = 0 00100000:10000000:0.0:1787134878.589029:0:15870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 525: rc = 0 00100000:10000000:0.0:1787134878.589334:0:15870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 525: rc = 0 00100000:10000000:0.0:1787134878.589921:0:15870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 476: rc = 0 00100000:10000000:0.0:1787134878.590233:0:15870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 476: rc = 0 00100000:10000000:0.0:1787134878.590478:0:15870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 476: rc = 0 00100000:10000000:0.0:1787134878.590868:0:15870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 476: rc = 0 00100000:10000000:0.0:1787134878.591429:0:15870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 476: rc = 0 00100000:10000000:0.0:1787134878.591676:0:15870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 476: rc = 0 00000100:00080000:1.0:1787134878.592471:0:14019:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787134878.592477:0:14019:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787134878.592482:0:14019:0:(import.c:65:import_set_state_nolock()) ffff98aa51547000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787134878.592491:0:14019:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:1.0:1787134878.592498:0:14019:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787134878.592506:0:14019:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98aa51547000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787134878.592533:0:14019:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a942205f80 x1873946312022528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787134878.592590:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312022144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787134878.592675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134878.592752:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312022784:0@lo:400:kworker.0 00000100:00100000:1.0:1787134878.592784:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134878.592811:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787134878.592817:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312022656:0@lo:400:kworker.0 00000100:00100000:1.0:1787134878.592840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134878.592870:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312022400:0@lo:400:kworker.0 00000100:00100000:1.0:1787134878.592910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134878.592928:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134878.592933:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312022272:0@lo:400:kworker.0 00000100:00100000:1.0:1787134878.592959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134878.592991:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312022528:0@lo:8:kworker.0 00000100:00100000:1.0:1787134878.593018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134878.593050:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312022784 00000100:00100000:1.0:1787134878.593057:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312022784 00000100:00100000:1.0:1787134878.593110:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312022656 00000100:00100000:1.0:1787134878.593113:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312022656 00000100:00100000:1.0:1787134878.593132:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787134878.593140:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312022784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134878.593205:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312022784:12345-0@lo:400:kworker.0 Request processed in 66us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134878.593212:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787134878.593227:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787134878.593233:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312022656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134878.593256:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873946312022656:12345-0@lo:400:kworker.0 Request processed in 23us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134878.593270:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787134878.593289:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312022272 00000100:00100000:1.0:1787134878.593293:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312022272 00000100:00100000:1.0:1787134878.593314:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787134878.593319:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+16:3308:x1873946312022272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134878.593350:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+16:3308:x1873946312022272:12345-0@lo:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134878.593356:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787134878.593378:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134878.593406:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312022272:0@lo:400:kworker.0 00010000:00080000:1.0:1787134878.593434:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98a942204a80 x1873946312022656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134878.593444:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873946312022656:0@lo:400:kworker.0 00010000:00080000:1.0:1787134878.593453:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98a942207800 x1873946312022784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134878.593461:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312022784:0@lo:400:kworker.0 00000100:00100000:3.0:1787134878.593708:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312022144 00000100:00100000:3.0:1787134878.593911:0:15154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312022144 00000100:00100000:3.0:1787134878.593963:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134878.593971:0:15154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312022144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134878.594009:0:15154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134878.594054:0:15154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312022144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134878.594060:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134878.594078:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312022400 00000100:00100000:3.0:1787134878.594082:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312022400 00000100:00100000:3.0:1787134878.594100:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312022528 00000100:00100000:3.0:1787134878.594103:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312022528 00000100:00100000:3.0:1787134878.594115:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787134878.594121:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312022400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134878.594173:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312022400:12345-0@lo:400:kworker.0 Request processed in 36us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134878.594179:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787134878.594190:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787134878.594194:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1873946312022528:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787134878.594209:0:15150:0:(ldlm_lib.c:1195:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1787134878.594832:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1787134878.600580:0:15870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787134878.600596:0:15870:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787134878.600610:0:15870:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x69932dacae907054 00000020:01000004:0.0:1787134878.600619:0:15870:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787134878.600657:0:15870:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.136@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787134878.600660:0:15870:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787134878.600667:0:15870:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787134878.600702:0:15870:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787134878.600706:0:15870:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:0.0:1787134878.602306:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787134878.602350:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312022144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134878.620322:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312022400:0@lo:400:kworker.0 00000100:00100000:3.0:1787134878.633594:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1873946312022528:12345-0@lo:8:kworker.0 Request processed in 39392us (40568us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787134878.633610:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787134878.634370:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa51547000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787134878.634380:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787134878.634384:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312022528:0@lo:8:kworker.0 00000040:01000000:3.0:1787134878.639769:0:15870:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787134878.639809:0:15870:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.136@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787134878.639813:0:15870:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787134878.639815:0:15870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787134878.639817:0:15870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787134878.639818:0:15870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787134878.639819:0:15870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787134878.639820:0:15870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787134878.639822:0:15870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787134878.639824:0:15870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787134878.639829:0:15870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787134878.641296:0:15870:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787134878.641306:0:15870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787134878.641307:0:15870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787134878.641309:0:15870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787134878.641310:0:15870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787134878.641311:0:15870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787134878.641313:0:15870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787134878.641314:0:15870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787134878.641316:0:15870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787134878.641317:0:15870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787134878.641355:0:15870:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787134878.641380:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312022912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787134878.641455:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134878.641553:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457afa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787134878.642142:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312022912 00000100:00100000:2.0:1787134878.642152:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312022912 00000100:00100000:2.0:1787134878.642382:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787134878.642395:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:15870:x1873946312022912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787134878.642434:0:14461:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787134878.642437:0:14461:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787134878.642441:0:14461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787134878.662963:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+16:15870:x1873946312022912:12345-0@lo:253:mount.lustre.0 Request processed in 20560us (21496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134878.662982:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787134878.663082:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312022912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787134878.663096:0:15870:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787134878.663099:0:15870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787134878.663101:0:15870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787134878.663103:0:15870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787134878.663104:0:15870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787134878.663105:0:15870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787134878.663107:0:15870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787134878.663108:0:15870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787134878.663110:0:15870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787134878.663111:0:15870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787134878.663134:0:15870:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98aa6ec5a800 from lustre-OST0001 10000000:01000000:3.0:1787134878.663251:0:15870:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787134878.663255:0:15870:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787134878.663264:0:15870:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98aa6ff58000 local copy 00010000:00010000:3.0:1787134878.663274:0:15870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134878.663530:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787134878.663584:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134878.663870:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457af900 going to sleep for 11 seconds 00000100:00100000:1.0:1787134878.663930:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312023040 00000100:00100000:1.0:1787134878.663938:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312023040 00000100:00100000:1.0:1787134878.664031:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787134878.664043:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:15870:x1873946312023040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134878.664403:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:15870:x1873946312023040:12345-0@lo:501:mount.lustre.0 Request processed in 362us (817us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787134878.664418:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787134878.664523:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023040:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787134878.664542:0:15870:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787134878.664874:0:15870:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787134878.664883:0:15870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134878.664893:0:15870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96800/0x69932dacae906dfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae906e01 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134878.664918:0:15870:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98aa6ec5a800 10000000:01000000:3.0:1787134878.664922:0:15870:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787134878.664928:0:15870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787134878.664931:0:15870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787134878.664935:0:15870:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787134878.664937:0:15870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787134878.664965:0:15870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a800/0x69932dacae90705b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134878.664973:0:15870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a800/0x69932dacae90705b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134878.664983:0:15870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a800/0x69932dacae90705b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134878.665000:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787134878.665029:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134878.665117:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457af900 going to sleep for 11 seconds 00000100:00100000:1.0:1787134878.665272:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312023168 00000100:00100000:1.0:1787134878.665278:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312023168 00000100:00100000:1.0:1787134878.665322:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787134878.665330:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:15870:x1873946312023168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787134878.665344:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134878.665362:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa6fbe7200/0x69932dacae907062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae90705b expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134878.665388:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa6fbe7200/0x69932dacae907062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae90705b expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134878.665399:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa6fbe7200/0x69932dacae907062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae90705b expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134878.665408:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7200, rc 0) 00000100:00100000:1.0:1787134878.665534:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023168:12345-0@lo:101:mount.lustre.0 Request processed in 205us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134878.665541:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787134878.665859:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787134878.665884:0:15870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a800/0x69932dacae90705b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae907062 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134878.665894:0:15870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a800/0x69932dacae90705b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae907062 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787134878.667459:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787134878.669153:0:15870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134878.669555:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787134878.669603:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787134878.669848:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787134878.669910:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787134878.669953:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787134878.669993:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787134878.670265:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787134878.670274:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787134878.670389:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134878.670464:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134878.670584:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81bd3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134878.671453:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312023296 00000100:00100000:3.0:1787134878.671464:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312023296 00000100:00100000:3.0:1787134878.671560:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787134878.671571:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787134878.672047:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023296:12345-0@lo:501:mount.lustre.0 Request processed in 478us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134878.672055:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787134878.672147:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787134878.672214:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787134878.672260:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134878.672739:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134878.672886:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312023424 00000100:00100000:1.0:1787134878.672893:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312023424 00000100:00100000:1.0:1787134878.672925:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787134878.672934:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787134878.673324:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023424:12345-0@lo:503:mount.lustre.0 Request processed in 390us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134878.673333:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787134878.673517:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787134878.674579:0:15870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787134878.675241:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787134878.675311:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134878.675354:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787134878.675480:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312023552 00000100:00100000:1.0:1787134878.675488:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312023552 00000100:00100000:1.0:1787134878.675540:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787134878.675550:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787134878.676076:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023552:12345-0@lo:502:mount.lustre.0 Request processed in 526us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134878.676085:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787134878.676198:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787134878.676860:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787134878.676916:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787134878.676944:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787134878.676988:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787134878.677019:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787134878.677050:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787134878.677089:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787134878.677117:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787134878.677153:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787134878.678471:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787134878.678554:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134878.682985:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134878.683593:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312023680 00000100:00100000:0.0:1787134878.683605:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312023680 00000100:00100000:2.0:1787134878.684382:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787134878.684395:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787134878.684929:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023680:12345-0@lo:502:mount.lustre.0 Request processed in 535us (6374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134878.684937:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787134878.685038:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787134878.685209:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787134878.685225:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787134878.686519:0:15873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787134878.686531:0:15873:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787134878.686538:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787134878.686540:0:15873:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787134878.686547:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787134878.686564:0:15873:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98aa6ff899c0) 00000020:00000080:1.0:1787134878.686589:0:15873:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787134878.686594:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787134878.686941:0:15873:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa6ec5a800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787134878.686950:0:15873:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787134878.686958:0:15873:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x69932dacae907070 00010000:00010000:1.0:1787134878.691854:0:15873:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787134878.692401:0:15873:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787134878.701395:0:15873:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787134878.708890:0:15873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787134878.708906:0:15873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134878.708914:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134878.708916:0:15873:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787134878.708921:0:15873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787134878.708925:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134878.708927:0:15873:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787134878.708929:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787134878.708931:0:15873:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787134878.708934:0:15873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134878.708937:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134878.708938:0:15873:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787134878.708941:0:15873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787134878.708943:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134878.708944:0:15873:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787134878.708947:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787134878.709011:0:15873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787134878.709014:0:15873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787134878.709016:0:15873:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787134878.709019:0:15873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787134878.709277:0:15870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787134878.709306:0:15870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787134878.709328:0:15870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a800/0x69932dacae90705b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae907062 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.709353:0:15870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa7a800/0x69932dacae90705b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae907062 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134878.709362:0:15870:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa6ec5a800 from 1 10000000:01000000:2.0:1787134878.709365:0:15870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787134878.709408:0:15870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.709417:0:15870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.709428:0:15870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134878.709455:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787134878.709526:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134878.709563:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134878.714273:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312023808 00000100:00100000:2.0:1787134878.714289:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312023808 00000100:00100000:2.0:1787134878.714350:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787134878.714361:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+17:15870:x1873946312023808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787134878.714379:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134878.714398:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae907077 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.714428:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae907077 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.714451:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae907077 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.714461:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96600, rc 0) 00000100:00100000:2.0:1787134878.714540:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312023808:12345-0@lo:101:mount.lustre.0 Request processed in 182us (5014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134878.714547:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787134878.715524:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787134878.715553:0:15870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134878.715580:0:15870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787134878.716150:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787134878.716512:0:15870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787134878.716759:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787134878.716810:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787134878.716872:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787134878.716881:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787134878.716953:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134878.717023:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134878.717075:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134878.719762:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312023936 00000100:00100000:1.0:1787134878.719779:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312023936 00000100:00100000:1.0:1787134878.719837:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787134878.719849:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa764e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312023936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134878.720150:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa764e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312023936:12345-0@lo:501:mount.lustre.0 Request processed in 302us (3125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134878.720183:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787134878.721304:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312023936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787134878.721365:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787134878.721431:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134878.721464:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134878.721543:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312024064 00000100:00100000:1.0:1787134878.721550:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312024064 00000100:00100000:1.0:1787134878.721594:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787134878.721603:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa764e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312024064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787134878.721994:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa764e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312024064:12345-0@lo:503:mount.lustre.0 Request processed in 391us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134878.722003:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787134878.722332:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787134878.725614:0:15870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787134878.730425:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787134878.730530:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134878.730581:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787134878.734616:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312024192 00000100:00100000:3.0:1787134878.734635:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312024192 00000100:00100000:3.0:1787134878.734724:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787134878.734735:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312024192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787134878.735108:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312024192:12345-0@lo:502:mount.lustre.0 Request processed in 374us (4577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134878.735119:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787134878.737656:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787134878.738033:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787134878.738095:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787134878.738141:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787134878.738227:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787134878.738261:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787134878.738304:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787134878.738335:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787134878.738368:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787134878.738419:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787134878.738501:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134878.738558:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787134878.739127:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312024320 00000100:00100000:2.0:1787134878.739139:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312024320 00000100:00100000:2.0:1787134878.739214:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787134878.739225:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312024320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787134878.739465:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312024320:12345-0@lo:502:mount.lustre.0 Request processed in 242us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134878.739473:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787134878.739836:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787134878.739957:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787134878.739971:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787134878.741509:0:15877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134878.741525:0:15877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134878.741527:0:15877:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787134878.741537:0:15877:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa6ec5a800 00000020:00000080:3.0:1787134878.741540:0:15877:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787134878.741549:0:15877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134878.741552:0:15877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134878.741554:0:15877:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787134878.741556:0:15877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134878.741559:0:15877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134878.741560:0:15877:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787134878.741563:0:15877:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98aa6ec5a800 00000020:00000080:3.0:1787134878.741565:0:15877:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787134878.741628:0:15877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134878.741632:0:15877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134878.741644:0:15877:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787134878.741648:0:15877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787134878.741650:0:15877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134878.741652:0:15877:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787134878.741656:0:15877:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98aa6ec5a800 00000020:00000080:3.0:1787134878.741658:0:15877:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787134878.741873:0:15877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787134878.741878:0:15877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787134878.741880:0:15877:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787134878.741884:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787134878.742056:0:15870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787134878.742085:0:15870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787134878.742108:0:15870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.742119:0:15870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134878.742190:0:15870:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787134878.742199:0:15870:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98aa6ec5a800 10000000:01000000:2.0:1787134878.742203:0:15870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98aa6ec5a800 10000000:01000000:2.0:1787134878.742207:0:15870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787134878.742213:0:15870:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98aa6ec5a800 from 1 10000000:01000000:2.0:1787134878.742215:0:15870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787134878.742254:0:15870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96a00/0x69932dacae907085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.742263:0:15870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96a00/0x69932dacae907085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.742274:0:15870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96a00/0x69932dacae907085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134878.742300:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787134878.742367:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134878.742413:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787134878.742501:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312024448 00000100:00100000:1.0:1787134878.742509:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312024448 00000100:00100000:1.0:1787134878.742558:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787134878.742567:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312024448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787134878.742580:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134878.742595:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa6fbe7e00/0x69932dacae90708c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae907085 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134878.742630:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa6fbe7e00/0x69932dacae90708c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae907085 expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134878.742641:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa6fbe7e00/0x69932dacae90708c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae907085 expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134878.742649:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7e00, rc 0) 00000100:00100000:1.0:1787134878.742700:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312024448:12345-0@lo:101:mount.lustre.0 Request processed in 133us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134878.742718:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787134878.742783:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787134878.742797:0:15870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96a00/0x69932dacae907085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90708c expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134878.742807:0:15870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96a00/0x69932dacae907085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae90708c expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787134878.743400:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787134878.743734:0:15870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787134878.743982:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787134878.744025:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787134878.744053:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787134878.744108:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787134878.744147:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787134878.744225:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787134878.744256:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787134878.744281:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787134878.744327:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787134878.744373:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787134878.744405:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787134878.744461:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787134878.744500:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787134878.744536:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787134878.744588:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787134878.744625:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787134878.744660:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787134878.744722:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787134878.744758:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787134878.744792:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787134878.744855:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787134878.744891:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787134878.744926:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787134878.744970:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787134878.745000:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787134878.745027:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787134878.745066:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787134878.745095:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787134878.745123:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787134878.745192:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787134878.745225:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787134878.745254:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787134878.745282:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787134878.745322:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787134878.745357:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787134878.745402:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787134878.745450:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787134878.745539:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787134878.745548:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787134878.745658:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134878.758691:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134878.758939:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81bd3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787134878.760890:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312024576 00000100:00100000:3.0:1787134878.760905:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312024576 00000100:00100000:3.0:1787134878.760973:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787134878.760984:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312024576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787134878.761339:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312024576:12345-0@lo:501:mount.lustre.0 Request processed in 357us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134878.761348:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787134878.762909:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787134878.762968:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787134878.763030:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134878.763070:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81bd3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787134878.764233:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312024704 00000100:00100000:0.0:1787134878.764245:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312024704 00000100:00100000:0.0:1787134878.764299:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787134878.764308:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312024704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787134878.765117:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312024704:12345-0@lo:503:mount.lustre.0 Request processed in 806us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134878.765127:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787134878.765250:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787134878.771050:0:15870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787134878.771179:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787134878.771267:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134878.771324:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a943455600 going to sleep for 11 seconds 00000100:00100000:0.0:1787134878.771360:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312024832 00000100:00100000:0.0:1787134878.771368:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312024832 00000100:00100000:0.0:1787134878.771416:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787134878.771425:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312024832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787134878.780463:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312024832:12345-0@lo:502:mount.lustre.0 Request processed in 9030us (9187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134878.780479:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787134878.780553:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787134878.780880:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787134878.780949:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787134878.780989:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787134878.781061:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787134878.781102:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787134878.781153:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787134878.781231:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787134878.781268:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787134878.781326:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787134878.781364:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787134878.781397:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787134878.781446:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787134878.781481:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787134878.781515:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787134878.781588:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787134878.781628:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787134878.781664:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787134878.781730:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787134878.781768:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787134878.781821:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787134878.781883:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787134878.781923:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787134878.781957:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787134878.782015:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787134878.782051:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787134878.782077:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787134878.782114:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787134878.782147:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787134878.782215:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787134878.782261:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787134878.782292:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787134878.782319:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787134878.782363:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787134878.782411:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787134878.782446:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787134878.782512:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787134878.782548:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787134878.782582:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787134878.782624:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787134878.782653:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787134878.782721:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787134878.782801:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134878.782852:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a943455600 going to sleep for 11 seconds 00000100:00100000:0.0:1787134878.782883:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312024960 00000100:00100000:0.0:1787134878.782890:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312024960 00000100:00100000:0.0:1787134878.782937:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787134878.782946:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312024960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787134878.783198:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312024960:12345-0@lo:502:mount.lustre.0 Request processed in 252us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134878.783206:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787134878.783294:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312024960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787134878.783366:0:15870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787134878.783376:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787134878.796136:0:15882:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787134878.796153:0:15882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98aa6ff599c0) 00000020:00000080:2.0:1787134878.802240:0:15882:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787134878.802459:0:15882:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98aa6ec5a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787134878.802464:0:15882:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98aa6ec5a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787134878.802467:0:15882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98aa6ec5a800 3 00010000:00080000:2.0:1787134878.802504:0:15882:0:(ldlm_lib.c:103:import_set_conn()) imp ffff98aa7bc5e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.136@tcp at head 00010000:00010000:2.0:1787134878.803945:0:15882:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787134878.804062:0:15882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787134878.804098:0:15882:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787134878.804109:0:15882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x69932dacae90709a 00000100:00080000:2.0:1787134878.804120:0:15882:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787134878.804126:0:15882:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98aa7bc5e000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787134878.804196:0:15882:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa81e40700 x1873946312025088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787134878.810066:0:15882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787134878.810999:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1873946312025088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787134878.811088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134878.813110:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312025088 00000100:00100000:0.0:1787134878.813125:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312025088 00000100:00100000:0.0:1787134878.813188:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134878.813196:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1873946312025088:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787134878.813227:0:14468:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1787134878.813267:0:14468:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x69932dacae9070a1 00000004:00100000:0.0:1787134878.813284:0:14468:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787134878.813401:0:14468:0:(import.c:65:import_set_state_nolock()) ffff98aa6ec5d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787134878.813557:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873946312025088:12345-0@lo:38:llog_process_th.0 Request processed in 360us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134878.813564:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787134878.813622:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98aa81e40700 x1873946312025088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787134888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134878.813634:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787134878.813642:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787134878.813651:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787134878.813656:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787134878.813658:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa7bc5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787134878.813663:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1873946312025088:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787134878.813991:0:15882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787134878.814150:0:15870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787134878.814207:0:15870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787134878.814225:0:15870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96a00/0x69932dacae907085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90708c expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134878.814235:0:15870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96a00/0x69932dacae907085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90708c expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787134878.814291:0:15870:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787134878.814294:0:15870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787134878.814295:0:15870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134878.814296:0:15870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134878.814297:0:15870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134878.814299:0:15870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134878.814300:0:15870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787134878.814302:0:15870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134878.814304:0:15870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787134878.814308:0:15870:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787134878.814315:0:15870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787134878.814317:0:15870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787134878.814318:0:15870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134878.814319:0:15870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134878.814320:0:15870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134878.814321:0:15870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134878.814321:0:15870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787134878.814322:0:15870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134878.814323:0:15870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787134878.815453:0:15870:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787134878.815478:0:15870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312025216:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787134878.815772:0:15870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134878.815823:0:15870:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a943455600 going to sleep for 11 seconds 00000100:00100000:0.0:1787134878.816006:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312025216 00000100:00100000:0.0:1787134878.816014:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312025216 00000100:00100000:0.0:1787134878.816099:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787134878.816110:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:15870:x1873946312025216:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787134878.816182:0:14461:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787134878.816201:0:14461:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787134878.846236:0:14461:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787134878.846260:0:14461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787134878.846298:0:14482:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787134878.846304:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787134878.846333:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134878.846349:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906f74 expref: 19 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134878.846356:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134878.846387:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae906f74 expref: 19 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134878.846415:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae906f74 expref: 19 pid: 14461 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134878.846427:0:14482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14482:1873946312025344:0@lo:104: 00000100:00100000:3.0:1787134878.846491:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134878.846536:0:14482:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457af780 going to sleep for 11 seconds 00000100:00100000:0.0:1787134878.846587:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312025344 00000100:00100000:0.0:1787134878.846596:0:14451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312025344 00000100:00100000:0.0:1787134878.846784:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787134878.846795:0:14451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+3:14482:x1873946312025344:12345-0@lo:104: 00010000:00010000:0.0:1787134878.846811:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134878.847074:0:14482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14482:1873946312025344:0@lo:104: 00010000:00010000:1.0:1787134878.847093:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134878.847124:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787134878.847132:0:14451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+3:14482:x1873946312025344:12345-0@lo:104: Request processed in 339us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134878.847140:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787134878.847295:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134878.847304:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.847314:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97400 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1787134878.847318:0:14455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.847327:0:14455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134878.847334:0:14455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134878.847341:0:14455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787134878.849854:0:14455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.849870:0:14455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787134878.849894:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.849902:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97400/0x69932dacae906f74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906f7b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.849926:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134878.849928:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134878.849946:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134878.849992:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312025472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134878.850063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134878.850136:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312025472 00000100:00100000:2.0:1787134878.850146:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312025472 00010000:00010000:2.0:1787134878.850207:0:14454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906f74 expref: 20 pid: 14461 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134878.850245:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787134878.850254:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:787f8101-2629-402b-af83-ff6c365f26f7+20:3307:x1873946312025472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134878.850268:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134878.850273:0:14454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906f74 expref: 20 pid: 14461 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850285:0:14454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae906f74 expref: 20 pid: 14461 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850301:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa81450200/0x69932dacae906f7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae906f74 expref: 20 pid: 14461 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850317:0:14454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850325:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787134878.850342:0:14454:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004038907s 00010000:00010000:2.0:1787134878.850347:0:14454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850354:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850370:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850377:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850383:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7aa00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134878.850387:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850398:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850420:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134878.850432:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134878.850472:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:787f8101-2629-402b-af83-ff6c365f26f7+19:3307:x1873946312025472:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134878.850480:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787134878.850547:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312025472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787134878.861066:0:14482:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134878.861088:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134878.861097:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa7aa00/0x69932dacae9070a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134878.881544:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+18:15870:x1873946312025216:12345-0@lo:253:mount.lustre.0 Request processed in 65427us (65763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134878.881561:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787134878.881701:0:15870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:787f8101-2629-402b-af83-ff6c365f26f7:15870:1873946312025216:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787134878.881721:0:15870:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787134878.881725:0:15870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787134878.881726:0:15870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787134878.881728:0:15870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787134878.881729:0:15870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787134878.881730:0:15870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787134878.881731:0:15870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787134878.881733:0:15870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787134878.881735:0:15870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787134878.881737:0:15870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787134878.881755:0:15870:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787134878.893824:0:15870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787134878.894037:0:15870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787134878.895058:0:15870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787134878.895520:0:15870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787134878.895947:0:15870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787134878.896141:0:15870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787134878.901353:0:15870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787134878.957944:0:15870:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787134878.957955:0:15870:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787134878.957992:0:15870:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787134878.958061:0:15870:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787134878.958079:0:15870:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787134878.958111:0:15870:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787134879.043249:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134880.069434:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787134880.259863:0:14463:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787134880.259874:0:14463:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98aa458e9800 from 8 10000000:01000000:2.0:1787134880.259881:0:14463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787134880.259949:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97800/0x69932dacae9070af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134880.259961:0:14463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97800/0x69932dacae9070af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134880.259974:0:14463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97800/0x69932dacae9070af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134880.260003:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312025600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787134880.260073:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134880.260117:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134880.260235:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312025600 00000100:00100000:1.0:1787134880.260244:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312025600 00000100:00100000:1.0:1787134880.260306:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787134880.260317:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+18:14463:x1873946312025600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787134880.260332:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134880.260347:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa6fbe7000/0x69932dacae9070b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae9070af expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134880.260384:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa6fbe7000/0x69932dacae9070b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae9070af expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134880.260395:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa6fbe7000/0x69932dacae9070b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae9070af expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134880.260404:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7000, rc 0) 00000100:00100000:1.0:1787134880.260454:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+19:14463:x1873946312025600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134880.260461:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787134880.260841:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312025600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787134880.260859:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97800/0x69932dacae9070af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae9070b6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134880.260869:0:14463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97800/0x69932dacae9070af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae9070b6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134880.260925:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312025728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787134880.260962:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134880.261000:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa6ff1be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787134880.261215:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312025728 00000100:00100000:0.0:1787134880.261221:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312025728 00000100:00100000:0.0:1787134880.261253:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787134880.261261:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa8164f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:14463:x1873946312025728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787134880.261277:0:14461:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787134880.261295:0:14461:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787134880.261298:0:14461:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787134880.261393:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa8164f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:14463:x1873946312025728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134880.261406:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787134880.261711:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312025728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787134880.261788:0:14463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787134880.261798:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97800/0x69932dacae9070af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae9070b6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134880.261807:0:14463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97800/0x69932dacae9070af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae9070b6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787134880.323360:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787134881.090286:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134882.119424:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134883.136478:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134883.715362:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787134883.715390:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312025856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787134883.715485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134883.715554:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312025856 00000100:00100000:3.0:1787134883.715563:0:15154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312025856 00000100:00100000:3.0:1787134883.715880:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787134883.715891:0:15154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312025856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134883.715928:0:15154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134883.715976:0:15154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312025856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134883.715984:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787134883.716006:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787134883.716044:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312025856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787134884.172944:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787134884.225407:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787134884.225414:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787134884.225418:0:475:0:(import.c:65:import_set_state_nolock()) ffff98aa51547000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787134884.225425:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:0.0:1787134884.225430:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787134884.225446:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98aa51547000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787134884.225469:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98aa819e4000 x1873946312026240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787134884.225538:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:787f8101-2629-402b-af83-ff6c365f26f7:3309:1873946312025984:0@lo:400:kworker.0 00000100:00100000:0.0:1787134884.225606:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134884.225662:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312026624:0@lo:400:kworker.0 00000100:00100000:0.0:1787134884.225689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134884.225713:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134884.225719:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312026112:0@lo:400:kworker.0 00000100:00100000:0.0:1787134884.225744:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134884.225785:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312026240:0@lo:8:kworker.0 00000100:00100000:0.0:1787134884.225808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134884.225835:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946312026368:0@lo:400:kworker.0 00000100:00100000:0.0:1787134884.225857:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134884.225873:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134884.225878:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312026496:0@lo:400:kworker.0 00000100:00100000:0.0:1787134884.225898:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134884.225917:0:15637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312026112 00000100:00100000:2.0:1787134884.225926:0:15637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312026112 00000100:00100000:0.0:1787134884.225931:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312025984 00000100:00100000:0.0:1787134884.225933:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312025984 00000100:00100000:2.0:1787134884.225962:0:15637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312026240 00000100:00100000:2.0:1787134884.225964:0:15637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312026240 00000100:00100000:0.0:1787134884.225965:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787134884.225972:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+19:3309:x1873946312025984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134884.225978:0:15637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787134884.225984:0:15637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312026112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134884.226021:0:15637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312026112:12345-0@lo:400:kworker.0 Request processed in 37us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134884.226029:0:15637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787134884.226043:0:15637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787134884.226047:0:15637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3306:x1873946312026240:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787134884.226069:0:15637:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1787134884.226097:0:15637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x69932dacae9070bd 00002000:00100000:2.0:1787134884.226109:0:15637:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98aa7bc5f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211390b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787134884.226113:0:15637:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787134884.226116:0:15637:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787134884.226439:0:15637:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787134884.226462:0:15637:0:(import.c:65:import_set_state_nolock()) ffff98aa7bc5b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787134884.226505:0:15637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1873946312026240:12345-0@lo:8:kworker.0 Request processed in 456us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134884.226513:0:15637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787134884.226837:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+19:3309:x1873946312025984:12345-0@lo:400:kworker.0 Request processed in 863us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134884.226845:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787134884.226875:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312026624 00000100:00100000:0.0:1787134884.226880:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312026624 00000100:00100000:0.0:1787134884.226913:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312026368 00000100:00100000:0.0:1787134884.226916:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312026368 00000100:00100000:0.0:1787134884.226929:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312026496 00000100:00100000:0.0:1787134884.226931:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312026496 00000100:00100000:0.0:1787134884.226944:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787134884.226949:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312026624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134884.226979:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873946312026624:12345-0@lo:400:kworker.0 Request processed in 30us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134884.226985:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787134884.226994:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787134884.226999:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946312026368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134884.227025:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946312026368:12345-0@lo:400:kworker.0 Request processed in 26us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134884.227031:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787134884.227041:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787134884.227047:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312026496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134884.227070:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873946312026496:12345-0@lo:400:kworker.0 Request processed in 25us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134884.227086:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787134884.227115:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787134884.227145:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa819e7800 x1873946312026496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134884.227176:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1873946312026496:0@lo:400:kworker.0 00010000:00080000:0.0:1787134884.227188:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa819e5f80 x1873946312026368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787134884.227197:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946312026368:0@lo:400:kworker.0 00010000:00080000:3.0:1787134884.231366:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa819e4000 x1873946312026240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787134909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134884.231395:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787134884.231406:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787134884.231416:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787134884.231423:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787134884.231427:0:3306:0:(import.c:65:import_set_state_nolock()) ffff98aa51547000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787134884.231444:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787134884.231451:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1873946312026240:0@lo:8:kworker.0 00000004:00080000:3.0:1787134884.231538:0:14491:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787134884.231560:0:14491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14491:1873946312026880:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787134884.231621:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134884.231662:0:14491:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457af9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134884.231676:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312026752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787134884.231700:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134884.231733:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312026752 00000100:00100000:3.0:1787134884.231740:0:15154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312026752 00000100:00100000:3.0:1787134884.231804:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787134884.231814:0:15154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1873946312026752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134884.231846:0:15154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134884.231889:0:15154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1873946312026752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134884.231897:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787134884.231916:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787134884.231935:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa7f66ce00 x1873946312026752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787134900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134884.231949:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312026752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787134884.231989:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312026112:0@lo:400:kworker.0 00000100:00100000:3.0:1787134884.232002:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:787f8101-2629-402b-af83-ff6c365f26f7:3309:1873946312025984:0@lo:400:kworker.0 00010000:00080000:3.0:1787134884.232017:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98aa819e6300 x1873946312026624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787134884.232025:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1873946312026624:0@lo:400:kworker.0 00000100:00100000:3.0:1787134884.232049:0:15637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312026880 00000100:00100000:3.0:1787134884.232052:0:15637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312026880 00000100:00100000:3.0:1787134884.232075:0:15637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787134884.232082:0:15637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14491:x1873946312026880:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787134884.234539:0:15637:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787134884.234551:0:15637:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787134884.234557:0:15637:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000004:00080000:0.0:1787134884.234940:0:14490:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787134884.235322:0:14490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 500202162307ns, next at 0ns, rc = 0 00002000:00010000:3.0:1787134884.259281:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.259297:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.259316:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.259321:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.259328:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.259348:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.259359:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.259374:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.259448:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787134884.260147:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.260184:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.260196:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.260200:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.260205:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.260216:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.266319:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.266340:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266563:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787134884.266573:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266590:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134884.266595:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266605:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266646:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266654:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f89442d/0x69932dacae9070c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266702:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787134884.266706:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266713:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:1.0:1787134884.266716:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266724:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266735:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134884.266742:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134884.266744:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134884.266755:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.271109:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787134884.271128:0:15637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae9070cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.271196:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.275064:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.275083:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.275104:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.275109:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.275117:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.275135:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.275146:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.275154:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.275202:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134884.275241:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134884.275249:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.275271:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134884.275276:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.275286:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.275308:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.275316:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f0f6d94/0x69932dacae9070d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.275900:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134884.275909:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134884.275911:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.276155:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.276185:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276195:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.276205:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.276210:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276221:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276245:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276253:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276270:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.276281:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.276286:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276293:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.276296:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276304:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276316:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276334:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae9070d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.276349:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.276351:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.276352:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.284188:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.284204:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.284848:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.284856:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.284864:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.284880:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.284891:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.284899:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.284923:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134884.285454:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134884.285463:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.285473:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134884.285479:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.285488:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.285516:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.285524:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d53c130/0x69932dacae9070e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.285546:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134884.285547:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134884.285549:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.285565:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.285575:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286139:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.286143:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.286149:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286179:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286188:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286196:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286214:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.286225:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.286230:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286237:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ac00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.286241:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286247:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286266:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286272:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae9070e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.286286:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.286288:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.286290:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.287233:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.287243:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287255:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.287258:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.287263:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287272:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287281:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287288:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287313:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.287324:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.287329:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287336:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.287340:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287348:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287361:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287368:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae9070ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.287384:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.287386:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.287388:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.288320:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.288330:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.288342:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.288352:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.288357:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.288367:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.288376:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.288384:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.288403:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.288416:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.288422:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.288430:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ba00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.288433:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.289747:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.289829:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.289853:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9070f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.289877:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.289879:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.289881:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.293182:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.293208:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293235:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.293241:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.293248:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293263:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293275:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293284:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293304:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.293319:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.293333:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293341:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.293346:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293356:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293375:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293383:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae9070fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.293411:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.293413:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.293415:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.297837:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.297853:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.297875:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.297879:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.297887:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.297916:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.297927:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.297934:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.297963:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787134884.298342:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134884.298351:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.298360:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134884.298365:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.298374:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.298393:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.298400:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e80308e4/0x69932dacae907103 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.298430:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134884.298432:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134884.298434:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.299635:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.299648:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.299661:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.299665:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.299670:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.299682:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.299692:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.299711:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.299733:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.300658:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.300667:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.300677:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ae00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.300681:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.300691:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.300708:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.300715:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae90710a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.300734:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.300736:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.300738:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.304153:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.304195:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.304213:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.304217:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.304309:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.304325:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.304335:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.304343:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.304366:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787134884.305803:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134884.305815:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.305827:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134884.305832:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.305843:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.305865:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.305872:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20d1887/0x69932dacae907111 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.305902:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134884.305904:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134884.305905:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.316951:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.316965:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.316984:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.316990:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.316997:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.317012:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.317031:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.317039:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.317077:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787134884.320519:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787134884.321527:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.321539:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.321554:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.321559:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.321571:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.322354:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.322364:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907118 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.322390:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.322403:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.322405:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.323084:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.323094:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.323109:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.323114:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.323121:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.323132:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.323142:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.323149:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.323199:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.323210:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.323215:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.324888:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7bc00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.324903:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.324937:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.324959:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.324966:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae90711f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.324992:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.324994:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.324997:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.327951:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.327965:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.327984:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.327989:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.327996:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.328011:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.328023:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.328037:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.328056:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787134884.329884:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134884.329898:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.329912:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134884.329917:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.329930:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.329950:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.329957:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c2a8e4/0x69932dacae907126 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.329978:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134884.329980:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134884.329981:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.330419:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.330427:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330815:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.330822:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.330828:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330840:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330849:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330857:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330876:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.330889:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.330893:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330908:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.330912:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330920:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330931:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330938:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae90712d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.330951:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.330953:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.330954:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.332809:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.332822:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332840:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.332844:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.332850:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332865:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332880:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332888:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332907:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.332919:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.332925:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332934:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ae00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.332938:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332947:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332964:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332971:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7e928f4/0x69932dacae907134 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.332989:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.332995:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.332996:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.333434:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.333441:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.333450:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.333453:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.333458:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.333467:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.333476:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.333483:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.333494:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787134884.334534:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.334542:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334553:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.334556:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.334561:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334576:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334585:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334592:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334608:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787134884.334620:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787134884.334637:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334645:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ba00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.334649:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334657:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334672:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334680:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae90713b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334701:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.334705:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334712:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.334715:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334723:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334733:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.334739:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000774086b3/0x69932dacae907142 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.335753:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.337018:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.337024:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.337026:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.338965:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.338978:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.338995:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.339000:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.339011:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.339026:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.339037:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.339046:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.339070:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.339088:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.339094:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.339101:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ac00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.339106:0:15634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.339115:0:15634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.339133:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.339151:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee561e99/0x69932dacae907149 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.339600:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.339602:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.339604:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.341092:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.341102:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.341118:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.341122:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.341127:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.341138:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.341149:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.341177:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.341203:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787134884.341456:0:14455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787134884.341469:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.341478:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:0.0:1787134884.341482:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.341491:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.341508:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.341516:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005350de64/0x69932dacae907150 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134884.341532:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134884.341534:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134884.341535:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787134884.342692:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787134884.342708:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342722:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1787134884.342726:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134884.342731:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342742:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342751:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342758:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342778:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.342792:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.342797:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342805:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7bc00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.342808:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342816:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342838:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342846:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5fbf15f/0x69932dacae907157 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.342862:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.342863:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.342865:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787134884.344408:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134884.344419:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.344432:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1787134884.344435:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134884.344440:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.344451:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.344460:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.344468:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.344490:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787134884.345040:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134884.345048:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345066:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1787134884.345069:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134884.345074:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345084:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345092:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345099:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345121:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787134884.345584:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134884.345590:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345613:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1787134884.345616:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134884.345621:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345640:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345798:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345806:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.345818:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787134884.345905:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787134884.345914:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.345923:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97200 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.345927:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.345936:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.345954:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.345962:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096582113/0x69932dacae90715e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.345990:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787134884.345993:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346000:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.346003:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346011:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346021:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346027:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d9523dd/0x69932dacae907165 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346037:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.346040:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346045:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.346048:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346066:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346076:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346083:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082a12228/0x69932dacae90716c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346097:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.346098:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.346100:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787134884.346226:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134884.346232:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.346240:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1787134884.346243:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134884.346248:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.346257:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.346264:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.346271:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.346299:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787134884.346324:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.346329:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346337:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97a00 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.346340:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346348:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346358:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346376:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dc733cb/0x69932dacae907173 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.346388:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.346390:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.346392:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787134884.346478:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787134884.347440:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787134884.347450:0:15637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.347464:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1787134884.347468:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134884.347472:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.347481:0:15637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.347492:0:15637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.347499:0:15637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134884.349178:0:15637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787134884.349913:0:15637:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1787134884.350035:0:15637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14491:x1873946312026880:12345-0@lo:5:osp-pre-1-0.0 Request processed in 117946us (118407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134884.350048:0:15637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787134884.350456:0:14491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14491:1873946312026880:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787134884.350473:0:14491:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787134884.350522:0:14491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14491:1873946312027008:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787134884.350562:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134884.351010:0:14491:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134884.351455:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312027008 00000100:00100000:2.0:1787134884.351475:0:15152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312027008 00000100:00100000:2.0:1787134884.351531:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787134884.351540:0:15152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14491:x1873946312027008:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787134884.352767:0:15152:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1787134884.354108:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134884.354121:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.354135:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97000 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134884.354141:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.354152:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.354188:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.354196:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5508e43/0x69932dacae90717a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134884.354221:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.354235:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134884.354238:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787134884.357913:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134884.377147:0:15152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14491:x1873946312027008:12345-0@lo:5:osp-pre-1-0.0 Request processed in 25599us (26575us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787134884.377191:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787134884.379268:0:14491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14491:1873946312027008:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787134884.379288:0:14491:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787134885.186835:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134886.211515:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787134886.851710:0:16227:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787134887.234107:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134888.262421:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134888.833411:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312027136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787134888.833498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134888.833696:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312027136 00000100:00100000:3.0:1787134888.833706:0:15154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312027136 00000100:00100000:3.0:1787134888.833775:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787134888.833786:0:15154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312027136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787134888.833832:0:15154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134888.833890:0:15154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312027136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134888.833899:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787134888.834522:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787134888.834574:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312027136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787134889.094668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134889.095408:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287908608 00000100:00100000:2.0:1787134889.095421:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287908608 00000100:00100000:2.0:1787134889.095595:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:2.0:1787134889.095605:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2348:x1873946287908608:12345-192.168.202.36@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787134889.095639:0:14459:0:(ldlm_lib.c:1449:target_handle_connect()) MGS: connection from deca4287-87b1-4d46-bf9c-d0ee99fafe78@192.168.202.36@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:2.0:1787134889.095674:0:14459:0:(genops.c:1406:class_connect()) connect: client deca4287-87b1-4d46-bf9c-d0ee99fafe78, cookie 0x69932dacae907181 00000100:00080000:2.0:1787134889.095803:0:14459:0:(import.c:65:import_set_state_nolock()) ffff98aa7bc5b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787134889.095887:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+5:2348:x1873946287908608:12345-192.168.202.36@tcp:250:mount.lustre.0 Request processed in 281us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.104189:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:0.0:1787134889.107674:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134889.108623:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287908736 00000100:00100000:2.0:1787134889.108638:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287908736 00000100:00100000:2.0:1787134889.108707:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:2.0:1787134889.108717:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+5:13777:x1873946287908736:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787134889.108734:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134889.108753:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa97400/0x69932dacae907188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac907067d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134889.108799:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa97400/0x69932dacae907188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907067d expref: 6 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134889.108810:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa97400/0x69932dacae907188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907067d expref: 6 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134889.108820:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97400, rc 0) 00000100:00100000:2.0:1787134889.108888:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+6:13777:x1873946287908736:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 172us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.108896:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:3.0:1787134889.113707:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134889.113891:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287908864 00000100:00100000:1.0:1787134889.113902:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287908864 00000100:00100000:1.0:1787134889.113968:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:1.0:1787134889.113978:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+6:13777:x1873946287908864:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787134889.114376:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+6:13777:x1873946287908864:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 398us (681us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787134889.114386:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:0.0:1787134889.121603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134889.121843:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287908992 00000100:00100000:1.0:1787134889.121855:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287908992 00000100:00100000:1.0:1787134889.121921:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:1.0:1787134889.121930:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+6:13777:x1873946287908992:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787134889.121947:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134889.121965:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa6fbe6400/0x69932dacae90718f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070684 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134889.121995:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa6fbe6400/0x69932dacae90718f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070684 expref: 7 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134889.122006:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa6fbe6400/0x69932dacae90718f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070684 expref: 7 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134889.122015:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6400, rc 0) 00000100:00100000:1.0:1787134889.122076:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+7:13777:x1873946287908992:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 147us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.122084:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:0.0:1787134889.125816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134889.125987:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287909120 00000100:00100000:2.0:1787134889.125998:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287909120 00000100:00100000:2.0:1787134889.126060:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:2.0:1787134889.126072:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+7:13777:x1873946287909120:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787134889.126410:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+8:13777:x1873946287909120:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 339us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.126419:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:3.0:1787134889.131909:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134889.132091:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287909248 00000100:00100000:0.0:1787134889.132103:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287909248 00000100:00100000:0.0:1787134889.132206:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:0.0:1787134889.132217:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+8:13777:x1873946287909248:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787134889.132824:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+8:13777:x1873946287909248:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 605us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.132845:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:0.0:1787134889.135563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134889.136061:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287909376 00000100:00100000:2.0:1787134889.136073:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287909376 00000100:00100000:2.0:1787134889.136134:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:2.0:1787134889.136143:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+8:13796:x1873946287909376:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787134889.136863:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+8:13796:x1873946287909376:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 717us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.136872:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:0.0:1787134889.147314:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134889.148622:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287909504 00000100:00100000:1.0:1787134889.148639:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287909504 00000100:00100000:1.0:1787134889.148714:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:1.0:1787134889.148973:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ac43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+8:13796:x1873946287909504:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787134889.149877:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ac43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+8:13796:x1873946287909504:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 1149us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.149889:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:3.0:1787134889.160834:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134889.160963:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287909632 00000100:00100000:2.0:1787134889.160983:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287909632 00000100:00100000:2.0:1787134889.161034:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:2.0:1787134889.161041:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+8:13777:x1873946287909632:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787134889.161055:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134889.161069:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa97200/0x69932dacae907196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac90706ae expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134889.161092:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa97200/0x69932dacae907196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706ae expref: 9 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134889.161100:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa97200/0x69932dacae907196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706ae expref: 9 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134889.161107:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97200, rc 0) 00000100:00100000:2.0:1787134889.161192:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+9:13777:x1873946287909632:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 117us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.161199:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:0.0:1787134889.163532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134889.163801:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287909760 00000100:00100000:1.0:1787134889.163811:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287909760 00000100:00100000:1.0:1787134889.163956:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:1.0:1787134889.163966:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+9:13777:x1873946287909760:12345-192.168.202.36@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787134889.163991:0:14460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787134889.164011:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787134889.164015:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787134889.164018:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787134889.164020:0:14460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787134889.165740:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+9:13777:x1873946287909760:12345-192.168.202.36@tcp:256:mount.lustre.0 Request processed in 1766us (2207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.165753:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:2.0:1787134889.170503:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134889.173404:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287909888 00000100:00100000:1.0:1787134889.173423:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287909888 00000100:00100000:1.0:1787134889.174461:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:1.0:1787134889.174633:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+9:13777:x1873946287909888:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787134889.174652:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134889.174685:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac90706b5 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134889.174714:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706b5 expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134889.174726:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706b5 expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134889.174736:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6a00, rc 0) 00000100:00100000:1.0:1787134889.174862:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13777:x1873946287909888:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 240us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.174871:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:0.0:1787134889.178909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134889.179004:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287910016 00000100:00100000:1.0:1787134889.179015:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287910016 00000100:00100000:1.0:1787134889.179077:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:1.0:1787134889.179088:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13777:x1873946287910016:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787134889.179466:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13777:x1873946287910016:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 378us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.179476:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:0.0:1787134889.181452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134889.181819:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287910144 00000100:00100000:2.0:1787134889.181830:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287910144 00000100:00100000:2.0:1787134889.181893:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:2.0:1787134889.181904:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13777:x1873946287910144:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787134889.182369:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13777:x1873946287910144:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 464us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.182379:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:2.0:1787134889.186352:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134889.186491:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287910272 00000100:00100000:3.0:1787134889.186502:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287910272 00000100:00100000:3.0:1787134889.186557:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:3.0:1787134889.186566:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13801:x1873946287910272:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787134889.186851:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13801:x1873946287910272:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 284us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134889.186860:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:0.0:1787134889.200416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134889.200518:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287910400 00000100:00100000:1.0:1787134889.200531:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287910400 00000100:00100000:1.0:1787134889.200601:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:1.0:1787134889.200612:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13801:x1873946287910400:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787134889.200891:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13801:x1873946287910400:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 280us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.200900:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:0.0:1787134889.207096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134889.207340:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287910528 00000100:00100000:1.0:1787134889.207352:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287910528 00000100:00100000:1.0:1787134889.207409:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787134889.207420:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1873946287910528:12345-192.168.202.36@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787134889.207452:0:14466:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from 8960d563-8403-4d98-8d5e-3187c5fedce5@192.168.202.36@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:1.0:1787134889.207503:0:14466:0:(genops.c:1406:class_connect()) connect: client 8960d563-8403-4d98-8d5e-3187c5fedce5, cookie 0x69932dacae9071a4 00000004:00100000:1.0:1787134889.207535:0:14466:0:(mdt_handler.c:7486:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1787134889.207541:0:14466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787134889.255232:0:14466:0:(import.c:65:import_set_state_nolock()) ffff98aa7bc59000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787134889.255322:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2348:x1873946287910528:12345-192.168.202.36@tcp:38:mount.lustre.0 Request processed in 47902us (48236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.255333:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:2.0:1787134889.258636:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134889.258682:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134889.258817:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287910656 00000100:00100000:3.0:1787134889.258827:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287910656 00000100:00100000:3.0:1787134889.258893:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287910784 00000100:00100000:3.0:1787134889.258896:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287910784 00000100:00100000:3.0:1787134889.258912:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787134889.258923:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+7:0:x1873946287910656:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787134889.258970:0:14468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787134889.259065:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+7:0:x1873946287910656:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 144us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134889.259089:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787134889.259106:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787134889.259113:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+6:13777:x1873946287910784:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787134889.259124:0:14468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787134889.259145:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+6:13777:x1873946287910784:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 33us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134889.259150:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00080000:1.0:1787134889.259751:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134889.261568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134889.261831:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287910912 00000100:00100000:3.0:1787134889.261842:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287910912 00000100:00100000:3.0:1787134889.261910:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787134889.261919:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+6:13777:x1873946287910912:12345-192.168.202.36@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787134889.262013:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+6:13777:x1873946287910912:12345-192.168.202.36@tcp:40:mount.lustre.0 Request processed in 94us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134889.262021:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787134889.264683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134889.264723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134889.264838:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287911296 00000100:00100000:1.0:1787134889.264847:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287911296 00000100:00100000:1.0:1787134889.264892:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787134889.264902:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+6:13777:x1873946287911296:12345-192.168.202.36@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787134889.265525:0:14469:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 557us 00000100:00100000:3.0:1787134889.268872:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134889.273201:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287911040 00000100:00100000:2.0:1787134889.273218:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287911040 00000100:00100000:2.0:1787134889.273280:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287911168 00000100:00100000:2.0:1787134889.273284:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287911168 00000100:00100000:2.0:1787134889.273315:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:2.0:1787134889.273324:0:15153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1873946287911040:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787134889.273353:0:15153:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from 8960d563-8403-4d98-8d5e-3187c5fedce5@192.168.202.36@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:2.0:1787134889.273381:0:15153:0:(genops.c:1406:class_connect()) connect: client 8960d563-8403-4d98-8d5e-3187c5fedce5, cookie 0x69932dacae9071ab 00002000:00100000:2.0:1787134889.273394:0:15153:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8960d563-8403-4d98-8d5e-3187c5fedce5/ffff98aa7bc5c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787134889.273405:0:15153:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787134889.273767:0:15153:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787134889.273803:0:15153:0:(import.c:65:import_set_state_nolock()) ffff98aa7bc5a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787134889.273884:0:15153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2348:x1873946287911040:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 559us (9158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.273893:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:2.0:1787134889.273914:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:2.0:1787134889.273919:0:15153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1873946287911168:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787134889.273937:0:15153:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from 8960d563-8403-4d98-8d5e-3187c5fedce5@192.168.202.36@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:2.0:1787134889.273953:0:15153:0:(genops.c:1406:class_connect()) connect: client 8960d563-8403-4d98-8d5e-3187c5fedce5, cookie 0x69932dacae9071b2 00002000:00100000:2.0:1787134889.273959:0:15153:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8960d563-8403-4d98-8d5e-3187c5fedce5/ffff98aa7bc58000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787134889.273983:0:15153:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787134889.274119:0:15153:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787134889.274141:0:15153:0:(import.c:65:import_set_state_nolock()) ffff98aa7bc5d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787134889.274192:0:15153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2348:x1873946287911168:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 270us (5327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.274199:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000004:00200000:2.0:1787134889.280898:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787134889.281099:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+6:13777:x1873946287911296:12345-192.168.202.36@tcp:33:mount.lustre.0 Request processed in 16191us (16420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134889.281116:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00010000:00010000:3.0:1787134889.281465:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134889.344543:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787134889.344569:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312027264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134889.344659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134889.345015:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312027520:0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.345049:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134889.345072:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787134889.345078:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:787f8101-2629-402b-af83-ff6c365f26f7:3310:1873946312027392:0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.345106:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134889.345128:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312027904:0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.345153:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134889.345196:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312027776:0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.345235:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134889.345254:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787134889.345341:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312027264 00000100:00100000:3.0:1787134889.345350:0:15154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312027264 00000100:00100000:3.0:1787134889.345422:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787134889.345433:0:15154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946312027264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787134889.345457:0:15154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134889.345498:0:15154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873946312027264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134889.345514:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787134889.345801:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134889.345905:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312027648:0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.345938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134889.345979:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312027392 00000100:00100000:1.0:1787134889.345983:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312027392 00000100:00100000:1.0:1787134889.346015:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787134889.346023:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:3310:x1873946312027392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.346063:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:3310:x1873946312027392:12345-0@lo:400:kworker.0 Request processed in 41us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.346069:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787134889.346111:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312027904 00000100:00100000:1.0:1787134889.346115:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312027904 00000100:00100000:1.0:1787134889.346141:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312027776 00000100:00100000:1.0:1787134889.346145:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312027776 00000100:00100000:1.0:1787134889.346188:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312027648 00000100:00100000:1.0:1787134889.346192:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312027648 00000100:00100000:1.0:1787134889.346207:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787134889.346214:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312027904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.346247:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312027904:12345-0@lo:400:kworker.0 Request processed in 34us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.346254:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787134889.346279:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787134889.346286:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312027776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134889.346311:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787134889.346318:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312027776:12345-0@lo:400:kworker.0 Request processed in 34us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.346324:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787134889.346334:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787134889.346342:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787134889.346347:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312027648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.346377:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312027648:12345-0@lo:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.346384:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787134889.346484:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134889.346513:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:787f8101-2629-402b-af83-ff6c365f26f7:3310:1873946312027392:0@lo:400:kworker.0 00010000:00080000:1.0:1787134889.346527:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942207100 x1873946312027904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134889.346538:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312027904:0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.346590:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312027264:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787134889.346617:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942207b80 x1873946312027648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134889.346626:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312027648:0@lo:400:kworker.0 00010000:00080000:1.0:1787134889.346634:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98a942206a00 x1873946312027776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787134905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787134889.346641:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312027776:0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.346665:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312027520 00000100:00100000:1.0:1787134889.346669:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312027520 00000100:00100000:1.0:1787134889.346699:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787134889.346705:0:15153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312027520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134889.346741:0:15153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312027520:12345-0@lo:400:kworker.0 Request processed in 36us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134889.346757:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787134889.346795:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312027520:0@lo:400:kworker.0 00000100:00100000:3.0:1787134889.459252:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134889.459504:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287911424 00000100:00100000:0.0:1787134889.459515:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287911424 00000100:00100000:0.0:1787134889.459591:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:0.0:1787134889.459602:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+6:13822:x1873946287911424:12345-192.168.202.36@tcp:101:mkdir.0 00010000:00010000:0.0:1787134889.459624:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134889.459652:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9071b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90706df expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134889.459720:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9071c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134889.459752:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9071c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134889.459769:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9071c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134889.459967:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787134889.459972:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134889.460742:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9071c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134889.460780:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9071b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706df expref: 8 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134889.460798:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9071c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706df expref: 7 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134889.460807:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531acf00) 00010000:00010000:0.0:1787134889.460810:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787134889.460813:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451400, rc 0) 00000100:00100000:0.0:1787134889.460882:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+7:13822:x1873946287911424:12345-192.168.202.36@tcp:101:mkdir.0 Request processed in 1282us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134889.460890:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000001:00100000:3.0:1787134889.505813:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8960d563-8403-4d98-8d5e-3187c5fedce5 00000001:00100000:3.0:1787134889.505842:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787134889.505854:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1787134890.304490:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787134890.562974:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787134891.248939:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.249109:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287911552 00000100:00100000:1.0:1787134891.249119:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287911552 00000100:00100000:1.0:1787134891.249325:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787134891.249337:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+7:13875:x1873946287911552:12345-192.168.202.36@tcp:41:lfs.0 00000004:00000024:1.0:1787134891.249495:0:14466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787134891.249882:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+7:13875:x1873946287911552:12345-192.168.202.36@tcp:41:lfs.0 Request processed in 548us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.249892:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00080000:2.0:1787134891.250965:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134891.256698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134891.256820:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287911680 00000100:00100000:3.0:1787134891.256832:0:15154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287911680 00000100:00100000:3.0:1787134891.256965:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787134891.256977:0:15154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8960d563-8403-4d98-8d5e-3187c5fedce5+6:13875:x1873946287911680:12345-192.168.202.36@tcp:13:lfs.0 00002000:00000024:3.0:1787134891.257016:0:15154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134891.257105:0:15154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8960d563-8403-4d98-8d5e-3187c5fedce5+6:13875:x1873946287911680:12345-192.168.202.36@tcp:13:lfs.0 Request processed in 130us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134891.257113:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00080000:2.0:1787134891.258510:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787134891.260630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134891.260899:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287911808 00000100:00100000:3.0:1787134891.260910:0:15154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287911808 00000100:00100000:3.0:1787134891.261041:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787134891.261053:0:15154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8960d563-8403-4d98-8d5e-3187c5fedce5+5:13875:x1873946287911808:12345-192.168.202.36@tcp:13:lfs.0 00002000:00000024:3.0:1787134891.261092:0:15154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787134891.261228:0:15154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8960d563-8403-4d98-8d5e-3187c5fedce5+5:13875:x1873946287911808:12345-192.168.202.36@tcp:13:lfs.0 Request processed in 178us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134891.261236:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00080000:2.0:1787134891.261549:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787134891.328972:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134891.465017:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.465138:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287911936 00000100:00100000:1.0:1787134891.465153:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287911936 00000100:00100000:1.0:1787134891.465258:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:1.0:1787134891.465270:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+10:13906:x1873946287911936:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787134891.465288:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134891.465307:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa6fbe7800/0x69932dacae9071c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac90706e6 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.465339:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa6fbe7800/0x69932dacae9071c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706e6 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.465350:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa6fbe7800/0x69932dacae9071c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706e6 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.465359:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7800, rc 0) 00000100:00100000:1.0:1787134891.465476:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13906:x1873946287911936:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 201us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.465484:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:0.0:1787134891.494886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.496579:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287912064 00000100:00100000:1.0:1787134891.496595:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287912064 00000100:00100000:1.0:1787134891.496731:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00100000:1.0:1787134891.496742:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13906:x1873946287912064:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787134891.497111:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13906:x1873946287912064:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 370us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.497118:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00100000:0.0:1787134891.502431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134891.502703:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287912192 00000100:00100000:2.0:1787134891.502714:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287912192 00000100:00100000:2.0:1787134891.502779:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:2.0:1787134891.502791:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13906:x1873946287912192:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787134891.503644:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13906:x1873946287912192:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 852us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134891.503654:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:0.0:1787134891.516065:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134891.524524:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287912320 00000100:00100000:3.0:1787134891.524540:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287912320 00000100:00100000:3.0:1787134891.524625:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:3.0:1787134891.524635:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13914:x1873946287912320:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787134891.525205:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13914:x1873946287912320:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 524us (9104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134891.525216:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:0.0:1787134891.559426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.559607:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287912448 00000100:00100000:1.0:1787134891.559618:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287912448 00000100:00100000:1.0:1787134891.559678:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 95 00000100:00100000:1.0:1787134891.559689:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13914:x1873946287912448:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787134891.560085:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13914:x1873946287912448:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 397us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.560094:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 95 00000100:00100000:0.0:1787134891.574020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.574494:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287912576 00000100:00100000:1.0:1787134891.574505:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287912576 00000100:00100000:1.0:1787134891.574578:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 96 00000100:00100000:1.0:1787134891.574589:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13906:x1873946287912576:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787134891.574606:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134891.574625:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa6fbe7a00/0x69932dacae9071ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070710 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.574656:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa6fbe7a00/0x69932dacae9071ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070710 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.574682:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa6fbe7a00/0x69932dacae9071ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070710 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.574692:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7a00, rc 0) 00000100:00100000:1.0:1787134891.574756:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13906:x1873946287912576:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 169us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.574764:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 96 00000100:00100000:2.0:1787134891.583733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.584025:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287912704 00000100:00100000:1.0:1787134891.584036:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287912704 00000100:00100000:1.0:1787134891.584121:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 97 00000100:00100000:1.0:1787134891.584131:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13906:x1873946287912704:12345-192.168.202.36@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787134891.584155:0:14460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787134891.584217:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787134891.584221:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787134891.584224:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787134891.584227:0:14460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787134891.587215:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13906:x1873946287912704:12345-192.168.202.36@tcp:256:mount.lustre.0 Request processed in 3073us (3479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134891.587229:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 97 00000100:00100000:3.0:1787134891.590682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134891.590837:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287912832 00000100:00100000:2.0:1787134891.590865:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287912832 00000100:00100000:2.0:1787134891.590933:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:2.0:1787134891.590944:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7fa4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13906:x1873946287912832:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787134891.590963:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134891.590983:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070717 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134891.591017:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070717 expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134891.591030:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070717 expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134891.591040:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96400, rc 0) 00000100:00100000:2.0:1787134891.591110:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7fa4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13906:x1873946287912832:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 168us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134891.591118:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:0.0:1787134891.593623:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134891.593703:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287912960 00000100:00100000:3.0:1787134891.593712:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287912960 00000100:00100000:3.0:1787134891.593762:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00100000:3.0:1787134891.593772:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13906:x1873946287912960:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787134891.594139:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13906:x1873946287912960:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 366us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134891.594148:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00100000:0.0:1787134891.599829:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.600066:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287913088 00000100:00100000:1.0:1787134891.600075:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287913088 00000100:00100000:1.0:1787134891.600123:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:1.0:1787134891.600132:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13906:x1873946287913088:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787134891.600631:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13906:x1873946287913088:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 498us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.600637:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:0.0:1787134891.605598:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134891.605775:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287913216 00000100:00100000:2.0:1787134891.605784:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287913216 00000100:00100000:2.0:1787134891.605875:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:2.0:1787134891.605884:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13919:x1873946287913216:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787134891.606107:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13919:x1873946287913216:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 224us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134891.606113:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:0.0:1787134891.616895:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.617055:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287913344 00000100:00100000:1.0:1787134891.617065:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287913344 00000100:00100000:1.0:1787134891.617150:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 102 00000100:00100000:1.0:1787134891.617197:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13919:x1873946287913344:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787134891.617453:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13919:x1873946287913344:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 257us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.617462:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 102 00000100:00100000:0.0:1787134891.631011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.631209:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287913472 00000100:00100000:1.0:1787134891.631222:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287913472 00000100:00100000:1.0:1787134891.631338:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787134891.631347:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1873946287913472:12345-192.168.202.36@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787134891.631379:0:14467:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from a6ebf304-0507-46d5-8ad2-f99a8ccc1df5@192.168.202.36@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:1.0:1787134891.631422:0:14467:0:(genops.c:1406:class_connect()) connect: client a6ebf304-0507-46d5-8ad2-f99a8ccc1df5, cookie 0x69932dacae9071dc 00000004:00100000:1.0:1787134891.631452:0:14467:0:(mdt_handler.c:7486:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:1.0:1787134891.631827:0:14467:0:(import.c:65:import_set_state_nolock()) ffff98aa721d9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787134891.631904:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:2348:x1873946287913472:12345-192.168.202.36@tcp:38:mount.lustre.0 Request processed in 556us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.631913:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787134891.648391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134891.648446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.648706:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287913728 00000100:00100000:1.0:1787134891.648719:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287913728 00000100:00100000:1.0:1787134891.648813:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287913600 00000100:00100000:1.0:1787134891.648816:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287913600 00000100:00100000:1.0:1787134891.648840:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787134891.648849:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+7:13906:x1873946287913728:12345-192.168.202.36@tcp:41:mount.lustre.0 00000100:00100000:3.0:1787134891.648879:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000004:00000024:1.0:1787134891.648882:0:14466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787134891.648888:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+7:2351:x1873946287913600:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787134891.648899:0:16342:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787134891.649062:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134891.649722:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+7:2351:x1873946287913600:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 828us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134891.649751:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787134891.651703:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:13906:x1873946287913728:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 2837us (3308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.651722:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:0.0:1787134891.663579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134891.663664:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287913856 00000100:00100000:3.0:1787134891.663674:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287913856 00000100:00100000:3.0:1787134891.663726:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:3.0:1787134891.663740:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:13906:x1873946287913856:12345-192.168.202.36@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787134891.663942:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:13906:x1873946287913856:12345-192.168.202.36@tcp:40:mount.lustre.0 Request processed in 208us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134891.663948:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787134891.667041:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134891.667073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134891.667122:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287914240 00000100:00100000:2.0:1787134891.667132:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287914240 00000100:00100000:0.0:1787134891.667140:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134891.667329:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:2.0:1787134891.667340:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:13906:x1873946287914240:12345-192.168.202.36@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787134891.667633:0:14470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787134891.667783:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:13906:x1873946287914240:12345-192.168.202.36@tcp:33:mount.lustre.0 Request processed in 444us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134891.667792:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:2.0:1787134891.670712:0:15637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287914112 00000100:00100000:1.0:1787134891.670712:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287913984 00000100:00100000:1.0:1787134891.670726:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287913984 00000100:00100000:1.0:1787134891.671452:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787134891.671461:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1873946287913984:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787134891.671500:0:15150:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from a6ebf304-0507-46d5-8ad2-f99a8ccc1df5@192.168.202.36@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:1.0:1787134891.671536:0:15150:0:(genops.c:1406:class_connect()) connect: client a6ebf304-0507-46d5-8ad2-f99a8ccc1df5, cookie 0x69932dacae9071e3 00002000:00100000:1.0:1787134891.671549:0:15150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a6ebf304-0507-46d5-8ad2-f99a8ccc1df5/ffff98aa721d8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787134891.671633:0:15150:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787134891.672242:0:15150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787134891.672280:0:15150:0:(import.c:65:import_set_state_nolock()) ffff98aa4313b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787134891.674979:0:15637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287914112 00000100:00100000:2.0:1787134891.675047:0:15637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:2.0:1787134891.675055:0:15637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1873946287914112:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787134891.675086:0:15637:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from a6ebf304-0507-46d5-8ad2-f99a8ccc1df5@192.168.202.36@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1787134891.675118:0:15637:0:(genops.c:1406:class_connect()) connect: client a6ebf304-0507-46d5-8ad2-f99a8ccc1df5, cookie 0x69932dacae9071ea 00002000:00100000:2.0:1787134891.675129:0:15637:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a6ebf304-0507-46d5-8ad2-f99a8ccc1df5/ffff98aa6fae6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211390b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787134891.675140:0:15637:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787134891.676056:0:15637:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787134891.676094:0:15637:0:(import.c:65:import_set_state_nolock()) ffff98aa6fae7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787134891.676459:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:2348:x1873946287913984:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 4993us (9379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.676472:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:2.0:1787134891.677249:0:15637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:2348:x1873946287914112:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 2189us (10103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134891.677269:0:15637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:2.0:1787134891.855286:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134891.855426:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287914368 00000100:00100000:1.0:1787134891.855437:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287914368 00000100:00100000:1.0:1787134891.855587:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:1.0:1787134891.855598:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:13940:x1873946287914368:12345-192.168.202.36@tcp:101:mkdir.0 00010000:00010000:1.0:1787134891.855621:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134891.855646:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae9071f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070741 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.855712:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.855727:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.855759:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134891.855962:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787134891.855967:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134891.856053:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.856081:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae9071f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070741 expref: 8 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.856099:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070741 expref: 7 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134891.856108:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531acf00) 00010000:00010000:1.0:1787134891.856110:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134891.856114:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6200, rc 0) 00000100:00100000:1.0:1787134891.857818:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+7:13940:x1873946287914368:12345-192.168.202.36@tcp:101:mkdir.0 Request processed in 2212us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134891.857829:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00010000:00010000:3.0:1787134892.357303:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134893.376397:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134893.960961:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787134893.960989:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312028032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134893.961061:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134893.961343:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312028032 00000100:00100000:1.0:1787134893.961352:0:15155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312028032 00000100:00100000:1.0:1787134893.961417:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787134893.961427:0:15155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312028032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134893.961461:0:15155:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134893.961514:0:15155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312028032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134893.961552:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787134893.963194:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134893.963253:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312028032:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787134894.072460:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a6ebf304-0507-46d5-8ad2-f99a8ccc1df5 00000001:00100000:2.0:1787134894.072477:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8960d563-8403-4d98-8d5e-3187c5fedce5 00010000:00010000:3.0:1787134894.404070:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134894.504367:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312028160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134894.504443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134894.504520:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312028160 00000100:00100000:1.0:1787134894.504529:0:15155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312028160 00000100:00100000:1.0:1787134894.504602:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787134894.504612:0:15155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312028160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134894.504655:0:15155:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134894.504705:0:15155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873946312028160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134894.504712:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787134894.504732:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787134894.504773:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787134894.504796:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1873946312028160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134894.504878:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312028416:0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.504908:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134894.504929:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787134894.504935:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946312028544:0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.506183:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134894.506247:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312028416 00000100:00100000:1.0:1787134894.506254:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312028416 00000100:00100000:1.0:1787134894.506305:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787134894.506313:0:15153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312028416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.506366:0:15153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312028416:12345-0@lo:400:kworker.0 Request processed in 54us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134894.506391:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787134894.506414:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312028544 00000100:00100000:1.0:1787134894.506419:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312028544 00000100:00100000:1.0:1787134894.506447:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787134894.506454:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946312028544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.506487:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946312028544:12345-0@lo:400:kworker.0 Request processed in 34us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134894.506494:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787134894.506523:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312028288:0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.506570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134894.506597:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa819e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946312028800:0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.506619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134894.506640:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787134894.506647:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a942207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312028672:0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.506669:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134894.506694:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312028288 00000100:00100000:1.0:1787134894.506698:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312028288 00000100:00100000:1.0:1787134894.506725:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787134894.506732:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+19:3308:x1873946312028288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.508140:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+19:3308:x1873946312028288:12345-0@lo:400:kworker.0 Request processed in 1406us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134894.508149:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787134894.508206:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312028800 00000100:00100000:1.0:1787134894.508212:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312028800 00000100:00100000:1.0:1787134894.508245:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312028672 00000100:00100000:1.0:1787134894.508248:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312028672 00000100:00100000:1.0:1787134894.508281:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787134894.508288:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946312028800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.508324:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873946312028800:12345-0@lo:400:kworker.0 Request processed in 37us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134894.508332:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787134894.508346:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787134894.508354:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312028672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.508385:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873946312028672:12345-0@lo:400:kworker.0 Request processed in 32us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134894.508391:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787134894.508421:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787134894.508464:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1873946312028672:0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.508480:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312028288:0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.508492:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa819e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1873946312028800:0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.508542:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946312028544:0@lo:400:kworker.0 00000100:00100000:1.0:1787134894.508556:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a942207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312028416:0@lo:400:kworker.0 00000001:00100000:3.0:1787134894.572672:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a6ebf304-0507-46d5-8ad2-f99a8ccc1df5 00000001:00100000:3.0:1787134894.572691:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8960d563-8403-4d98-8d5e-3187c5fedce5 00000001:00100000:3.0:1787134894.599233:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a6ebf304-0507-46d5-8ad2-f99a8ccc1df5 00000001:02000400:3.0:1787134894.875186:0:16431:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787134895.431962:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134896.451683:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134896.884148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134896.884308:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287914496 00000100:00100000:1.0:1787134896.884318:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287914496 00000100:00100000:1.0:1787134896.884382:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00100000:1.0:1787134896.884394:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:2349:x1873946287914496:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134896.884468:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:2349:x1873946287914496:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134896.884486:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00100000:1.0:1787134896.888391:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134896.888434:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134896.888455:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134896.888478:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134896.888582:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134896.888612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134896.888696:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287914624 00000100:00100000:1.0:1787134896.888703:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287914752 00000100:00100000:0.0:1787134896.888710:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287914624 00000100:00100000:1.0:1787134896.888775:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287914752 00000100:00100000:0.0:1787134896.888778:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287915008 00000100:00100000:0.0:1787134896.888780:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287915008 00000100:00100000:1.0:1787134896.888798:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287914880 00000100:00100000:1.0:1787134896.888801:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287914880 00000100:00100000:0.0:1787134896.888803:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:0.0:1787134896.888813:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2350:x1873946287914624:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134896.888815:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287915136 00000100:00100000:1.0:1787134896.888817:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287915136 00000100:00100000:1.0:1787134896.888826:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287915264 00000100:00100000:1.0:1787134896.888828:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287915264 00000100:00100000:1.0:1787134896.888841:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787134896.888847:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2350:x1873946287914752:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134896.888894:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2350:x1873946287914624:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 81us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134896.888901:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:0.0:1787134896.888920:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:0.0:1787134896.888927:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:2350:x1873946287915008:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134896.889026:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2350:x1873946287914752:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 178us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134896.889033:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787134896.889048:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:1.0:1787134896.889054:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2350:x1873946287914880:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134896.889080:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2350:x1873946287914880:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 26us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134896.889087:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:1.0:1787134896.889098:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:1.0:1787134896.889104:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2350:x1873946287915136:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134896.889293:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2350:x1873946287915136:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 188us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134896.889310:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:1.0:1787134896.889322:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:1.0:1787134896.889328:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2350:x1873946287915264:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134896.889353:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2350:x1873946287915264:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 25us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134896.889359:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:0.0:1787134896.889681:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:2350:x1873946287915008:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 753us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134896.889696:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00080000:0.0:1787134896.889717:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787134896.889722:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787134896.889724:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787134897.475309:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134898.497428:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134899.078769:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312028928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787134899.078843:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134899.079017:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312028928 00000100:00100000:1.0:1787134899.079026:0:15155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312028928 00000100:00100000:1.0:1787134899.079094:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787134899.079105:0:15155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312028928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134899.079142:0:15155:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134899.079219:0:15155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312028928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134899.079227:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787134899.079275:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312028928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787134899.079368:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787134899.520873:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134899.584536:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787134899.584572:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312029056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787134899.584813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134899.584883:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312029056 00000100:00100000:1.0:1787134899.584892:0:15155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312029056 00000100:00100000:1.0:1787134899.584959:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787134899.584969:0:15155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312029056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134899.585009:0:15155:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134899.585058:0:15155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312029056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134899.585077:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787134899.585126:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312029056:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787134899.586728:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787134899.586748:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312029184:0@lo:400:kworker.0 00000100:00100000:0.0:1787134899.586809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134899.586848:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134899.586854:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946312029312:0@lo:400:kworker.0 00000100:00100000:0.0:1787134899.586881:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134899.587064:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312029184 00000100:00100000:0.0:1787134899.587072:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312029184 00000100:00100000:0.0:1787134899.587115:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787134899.587123:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+19:3307:x1873946312029184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134899.587184:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+19:3307:x1873946312029184:12345-0@lo:400:kworker.0 Request processed in 63us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134899.587191:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787134899.587221:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312029312 00000100:00100000:0.0:1787134899.587225:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312029312 00000100:00100000:0.0:1787134899.587252:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787134899.587259:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946312029312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134899.587290:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873946312029312:12345-0@lo:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134899.587308:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787134899.587366:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873946312029312:0@lo:400:kworker.0 00000100:00100000:0.0:1787134899.587388:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312029184:0@lo:400:kworker.0 00000100:00100000:3.0:1787134899.587597:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312029568:0@lo:400:kworker.0 00000100:00100000:3.0:1787134899.587639:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134899.587662:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787134899.587668:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312029440:0@lo:400:kworker.0 00000100:00100000:3.0:1787134899.587694:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134899.587742:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312029568 00000100:00100000:3.0:1787134899.587746:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312029568 00000100:00100000:3.0:1787134899.587774:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312029440 00000100:00100000:3.0:1787134899.587776:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312029440 00000100:00100000:3.0:1787134899.587799:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787134899.587805:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312029568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134899.587841:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312029568:12345-0@lo:400:kworker.0 Request processed in 36us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134899.587847:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787134899.587859:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787134899.587865:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312029440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134899.587888:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312029440:12345-0@lo:400:kworker.0 Request processed in 24us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134899.587894:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787134899.587934:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134899.588264:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312029440:0@lo:400:kworker.0 00000100:00100000:3.0:1787134899.588274:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312029568:0@lo:400:kworker.0 00000020:00000080:2.0:1787134899.728293:0:16579:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5410bcd0 20000000:00000080:2.0:1787134899.728309:0:16579:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98aa7d880c00 uarg=0000000000000000 20000000:01000000:2.0:1787134899.728339:0:16579:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787134899.728345:0:16579:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787134899.728348:0:16579:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787134899.729873:0:16580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787134899.730007:0:16579:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787134899.739078:0:16579:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787134899.739115:0:16579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134899.739140:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906eef expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134899.739149:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae906f3c expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134899.739621:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae907077 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134899.739636:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706b5 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134899.739643:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070717 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134899.739650:0:16579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.739930:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070717 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.739948:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070717 expref: 12 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134899.739965:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312029696:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134899.740092:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90706b5 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.740100:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90706b5 expref: 12 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134899.740110:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312029824:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134899.740142:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae907077 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.740152:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae907077 expref: 18 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134899.746195:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134899.748060:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287915392 00000100:00100000:3.0:1787134899.748080:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287915392 00010000:00010000:3.0:1787134899.748145:0:14454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070717 expref: 13 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134899.748232:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:3.0:1787134899.748244:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:2352:x1873946287915392:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787134899.748270:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134899.748278:0:14454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070717 expref: 13 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134899.754828:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312029952:0@lo:104: 00000100:00100000:0.0:1787134899.754929:0:16579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134899.755107:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312029952 00000100:00100000:2.0:1787134899.755120:0:14451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312029952 00000100:00100000:2.0:1787134899.755208:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787134899.755220:0:14451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+3:16579:x1873946312029952:12345-0@lo:104: 00000100:00100000:1.0:1787134899.755220:0:14450:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787134899.755233:0:14450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1787134899.755369:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.755437:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787134899.755444:0:14451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+3:16579:x1873946312029952:12345-0@lo:104: Request processed in 227us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134899.755452:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787134899.755479:0:15634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787134899.755501:0:15634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.755530:0:15634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1787134899.755535:0:15634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.755543:0:15634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787134899.755752:0:15634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134899.755759:0:15634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787134899.755812:0:15634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.755820:0:15634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787134899.755848:0:15634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.755855:0:15634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96000/0x69932dacae907077 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae90707e expref: -99 pid: 15870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.755874:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134899.755875:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134899.755877:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134899.755902:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312030080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134899.755943:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134899.757320:0:14452:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787134899.757339:0:14452:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787134899.758376:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312030080 00000100:00100000:2.0:1787134899.758394:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312030080 00010000:00010000:2.0:1787134899.758444:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae907077 expref: 19 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134899.758523:0:14452:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787134899.758538:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787134899.758591:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:787f8101-2629-402b-af83-ff6c365f26f7+19:3307:x1873946312030080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134899.758610:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134899.758615:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae907077 expref: 19 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.762496:0:14454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070717 expref: 13 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.762537:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134899.763706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134899.763753:0:14453:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787134899.763768:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287915520 00000100:00100000:1.0:1787134899.763774:0:14453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287915520 00010000:00010000:1.0:1787134899.763802:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90706b5 expref: 14 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.764042:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae906f3c expref: 19 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.764061:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae906f3c expref: 19 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134899.764077:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312030208:0@lo:104: 00000100:00100000:0.0:1787134899.764124:0:16579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787134899.764150:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae907077 expref: 19 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.764194:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x69932dacae906eef expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.764203:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x69932dacae906eef expref: 19 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.764213:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134899.764213:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312030336:0@lo:104: 00000100:00100000:2.0:1787134899.764237:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312030208 00000100:00100000:0.0:1787134899.764239:0:16579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134899.764242:0:14451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312030208 00000100:00100000:0.0:1787134899.764262:0:16579:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787134899.764283:0:14451:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1787134899.764287:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa96400/0x69932dacae9071d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070717 expref: 14 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134899.764295:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312030336 00000100:00100000:2.0:1787134899.764300:0:14451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312030336 00000100:00100000:2.0:1787134899.764316:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787134899.764324:0:14451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+4:16579:x1873946312030208:12345-0@lo:104: 00010000:00010000:2.0:1787134899.764337:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.764385:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787134899.764391:0:14451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+4:16579:x1873946312030208:12345-0@lo:104: Request processed in 68us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134899.764399:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787134899.764416:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787134899.764429:0:14451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fe6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+3:16579:x1873946312030336:12345-0@lo:104: 00010000:00010000:2.0:1787134899.764436:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.764468:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787134899.764473:0:14451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fe6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:787f8101-2629-402b-af83-ff6c365f26f7+3:16579:x1873946312030336:12345-0@lo:104: Request processed in 45us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134899.764478:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787134899.764649:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:787f8101-2629-402b-af83-ff6c365f26f7+19:3307:x1873946312030080:12345-0@lo:103:ldlm_bl.0 Request processed in 6102us (8705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134899.764657:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787134899.764685:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312030080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134899.764709:0:14452:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787134899.764717:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:2.0:1787134899.764724:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa764e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+14:2351:x1873946287915520:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134899.764733:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134899.764739:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90706b5 expref: 14 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.764750:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90706b5 expref: 14 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.764760:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134899.764795:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa764e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+14:2351:x1873946287915520:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 72us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134899.764802:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:2.0:1787134899.764994:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:2352:x1873946287915392:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 16751us (18843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134899.765007:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00010000:00010000:3.0:1787134899.765541:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787134899.765550:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.765560:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6e00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134899.765565:0:14456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.765574:0:14456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134899.765594:0:14456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787134899.765600:0:14456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787134899.765639:0:14456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.765646:0:14456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134899.765672:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.765680:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa6fbe6e00/0x69932dacae906f3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906f43 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134899.765691:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312030464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134899.765693:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134899.765699:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.765707:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96c00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1787134899.765711:0:14456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.765719:0:14456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787134899.765726:0:14456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134899.765734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787134899.765738:0:14456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787134899.765768:0:14456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.765774:0:14456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787134899.765793:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134899.765800:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff98aa7fa96c00/0x69932dacae906eef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x69932dacae906ef6 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134899.765802:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787134899.765814:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:787f8101-2629-402b-af83-ff6c365f26f7:3310:1873946312030592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787134899.765822:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134899.765826:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134899.765828:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134899.765841:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134899.765869:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312030464 00000100:00100000:2.0:1787134899.765875:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312030464 00010000:00010000:2.0:1787134899.765896:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906f3c expref: 19 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134899.765916:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312030592 00000100:00100000:2.0:1787134899.765919:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312030592 00010000:00010000:2.0:1787134899.765931:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906eef expref: 20 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134899.765959:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787134899.765966:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:787f8101-2629-402b-af83-ff6c365f26f7+20:3308:x1873946312030464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134899.765977:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134899.765982:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906f3c expref: 20 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.765994:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae906f3c expref: 20 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766023:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134899.766054:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:787f8101-2629-402b-af83-ff6c365f26f7+20:3308:x1873946312030464:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134899.766069:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787134899.766097:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:787f8101-2629-402b-af83-ff6c365f26f7:3308:1873946312030464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787134899.766116:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787134899.766122:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:787f8101-2629-402b-af83-ff6c365f26f7+19:3310:x1873946312030592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787134899.766130:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134899.766134:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x69932dacae906eef expref: 19 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766143:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x69932dacae906eef expref: 19 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766156:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766184:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766199:0:14452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766206:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766214:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766221:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766250:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe7600 already unused, calling callback (ffffffffc1502390) 00010000:00010000:2.0:1787134899.766255:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766262:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766271:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134899.766281:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134899.766309:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:787f8101-2629-402b-af83-ff6c365f26f7+19:3310:x1873946312030592:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134899.766316:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787134899.766337:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:787f8101-2629-402b-af83-ff6c365f26f7:3310:1873946312030592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787134899.767605:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312029696:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134899.767633:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa6fbe6a00/0x69932dacae90719d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90706b5 expref: 11 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134899.767643:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312029824:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134899.767655:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa7fa96600/0x69932dacae90707e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae907077 expref: 18 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134899.767664:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312029952:0@lo:104: 00010000:00010000:0.0:1787134899.767675:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa81451800/0x69932dacae906f43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae906f3c expref: 17 pid: 14460 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134899.767696:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312030208:0@lo:104: 00010000:00010000:0.0:1787134899.767708:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa81451000/0x69932dacae906ef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x69932dacae906eef expref: 16 pid: 14459 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134899.767715:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1873946312030336:0@lo:104: 00010000:00010000:0.0:1787134899.767738:0:16579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.767748:0:16579:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.767755:0:16579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134899.767761:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa6fbe7600/0x69932dacae9071ff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134899.768418:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134900.544672:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787134900.802944:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787134901.057686:0:14463:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787134901.057695:0:14463:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa6ec5a800 from 10 10000000:01000000:0.0:1787134901.057701:0:14463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787134901.057747:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81451800/0x69932dacae907206 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.057760:0:14463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa81451800/0x69932dacae907206 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.057772:0:14463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa81451800/0x69932dacae907206 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134901.057810:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312030720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.057877:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134901.057926:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787134901.057950:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312030720 00000100:00100000:0.0:1787134901.057958:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312030720 00000100:00100000:0.0:1787134901.058008:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787134901.058017:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+16:14463:x1873946312030720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134901.058032:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134901.058048:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81451000/0x69932dacae90720d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae907206 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.058072:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81451000/0x69932dacae90720d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae907206 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.058082:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81451000/0x69932dacae90720d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae907206 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.058090:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451000, rc 0) 00000100:00100000:0.0:1787134901.058131:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+17:14463:x1873946312030720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134901.058138:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787134901.058211:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312030720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134901.058226:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa81451800/0x69932dacae907206 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90720d expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.058235:0:14463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa81451800/0x69932dacae907206 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae90720d expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134901.058293:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312030848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.058317:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134901.058331:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787134901.058344:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312030848 00000100:00100000:0.0:1787134901.058348:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312030848 00000100:00100000:0.0:1787134901.058384:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787134901.058391:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+17:14463:x1873946312030848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.060035:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+17:14463:x1873946312030848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1637us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134901.060047:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787134901.068065:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312030848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.075515:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312030976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.075602:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134901.075649:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787134901.075857:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312030976 00000100:00100000:1.0:1787134901.075866:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312030976 00000100:00100000:1.0:1787134901.075918:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787134901.075927:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+17:14463:x1873946312030976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787134901.076126:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+17:14463:x1873946312030976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134901.076135:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787134901.076342:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312030976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787134901.077685:0:16619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787134901.080435:0:14463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787134901.080467:0:14463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787134901.080489:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81451800/0x69932dacae907206 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90720d expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134901.080502:0:14463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa81451800/0x69932dacae907206 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90720d expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787134901.080512:0:14463:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787134901.080515:0:14463:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa6aa84800 from 10 10000000:01000000:2.0:1787134901.080525:0:14463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787134901.080564:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97000/0x69932dacae907214 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134901.080572:0:14463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97000/0x69932dacae907214 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134901.080583:0:14463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97000/0x69932dacae907214 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134901.080609:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787134901.080677:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134901.080728:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7ae6ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134901.081929:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312031104 00000100:00100000:3.0:1787134901.081940:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312031104 00000100:00100000:3.0:1787134901.081991:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787134901.082001:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+17:14463:x1873946312031104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134901.082016:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134901.082031:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7ac00/0x69932dacae90721b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae907214 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134901.082054:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7ac00/0x69932dacae90721b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae907214 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134901.082065:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7ac00/0x69932dacae90721b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae907214 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134901.082074:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7ac00, rc 0) 00000100:00100000:3.0:1787134901.082129:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+18:14463:x1873946312031104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134901.082145:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787134901.082225:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134901.082241:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97000/0x69932dacae907214 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90721b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134901.082250:0:14463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97000/0x69932dacae907214 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae90721b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134901.082307:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134901.082339:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134901.082367:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa520a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134901.085484:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312031232 00000100:00100000:0.0:1787134901.085500:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312031232 00000100:00100000:0.0:1787134901.085560:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787134901.085570:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6ec40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+18:14463:x1873946312031232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.085880:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6ec40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+18:14463:x1873946312031232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134901.085889:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787134901.085995:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134901.086064:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787134901.086113:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134901.086187:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa520a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134901.086350:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312031360 00000100:00100000:0.0:1787134901.086356:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312031360 00000100:00100000:0.0:1787134901.086388:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787134901.086395:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+18:14463:x1873946312031360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.086857:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+18:14463:x1873946312031360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 461us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134901.086865:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787134901.093939:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787134901.104793:0:16621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787134901.116078:0:14463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787134901.116129:0:14463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787134901.116149:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97000/0x69932dacae907214 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90721b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134901.116654:0:14463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa7fa97000/0x69932dacae907214 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae90721b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134901.116826:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 10000000:01000000:0.0:1787134901.116845:0:14463:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787134901.116848:0:14463:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98aa458e9800 from 10 10000000:01000000:0.0:1787134901.116852:0:14463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787134901.116891:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450600/0x69932dacae907222 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.116900:0:14463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff98aa81450600/0x69932dacae907222 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.116918:0:14463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff98aa81450600/0x69932dacae907222 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134901.116945:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.117002:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134901.117049:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287915648 00000100:00100000:0.0:1787134901.117058:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287915648 00000100:00100000:0.0:1787134901.117125:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312031488 00000100:00100000:0.0:1787134901.117129:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312031488 00000100:00100000:0.0:1787134901.117361:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 112 00000100:00100000:0.0:1787134901.117372:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+11:13791:x1873946287915648:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134901.117386:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134901.117400:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81450200/0x69932dacae907229 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac9070748 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.117441:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81450200/0x69932dacae907229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070748 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.117451:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81450200/0x69932dacae907229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070748 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.117460:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450200, rc 0) 00000100:00100000:0.0:1787134901.117521:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13791:x1873946287915648:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 150us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134901.117528:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 112 00000100:00100000:0.0:1787134901.117554:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787134901.117560:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+18:14463:x1873946312031488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134901.117567:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134901.117575:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa81451200/0x69932dacae907230 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x69932dacae907222 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.117588:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa81451200/0x69932dacae907230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x69932dacae907222 expref: 19 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.117596:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa81451200/0x69932dacae907230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x69932dacae907222 expref: 19 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.117603:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451200, rc 0) 00000100:00100000:0.0:1787134901.117630:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:14463:x1873946312031488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134901.117636:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787134901.117768:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134901.117798:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787134901.117814:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff98aa81450600/0x69932dacae907222 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae907230 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134901.117823:0:14463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff98aa81450600/0x69932dacae907222 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x69932dacae907230 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134901.117875:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.117901:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134901.117922:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312031616 00000100:00100000:0.0:1787134901.117925:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312031616 00000100:00100000:0.0:1787134901.117943:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787134901.117949:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:14463:x1873946312031616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.118828:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:14463:x1873946312031616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 876us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134901.118837:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787134901.118878:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787134901.118893:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.118928:0:14463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787134901.118969:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134901.119036:0:14463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa47fb73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787134901.127540:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312031744 00000100:00100000:3.0:1787134901.127567:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312031744 00000100:00100000:3.0:1787134901.127758:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134901.127784:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287915776 00000100:00100000:3.0:1787134901.127788:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287915776 00000100:00100000:3.0:1787134901.127831:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:3.0:1787134901.127841:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13791:x1873946287915776:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787134901.128139:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13791:x1873946287915776:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 298us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134901.128333:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787134901.128342:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+19:14463:x1873946312031744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787134901.128719:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:1.0:1787134901.132913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134901.132992:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287915904 00000100:00100000:3.0:1787134901.133003:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287915904 00000100:00100000:3.0:1787134901.133088:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:3.0:1787134901.133099:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13791:x1873946287915904:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787134901.133374:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13791:x1873946287915904:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 276us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134901.133383:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:2.0:1787134901.133512:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:787f8101-2629-402b-af83-ff6c365f26f7+19:14463:x1873946312031744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5169us (14539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134901.133520:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787134901.133622:0:14463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:787f8101-2629-402b-af83-ff6c365f26f7:14463:1873946312031744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787134901.147430:0:16627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787134901.149529:0:14463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787134901.149558:0:14463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787134901.149570:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff98aa81450600/0x69932dacae907222 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae907230 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134901.149583:0:14463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff98aa81450600/0x69932dacae907222 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x69932dacae907230 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134901.154958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134901.154996:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287916032 00000100:00100000:3.0:1787134901.155007:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287916032 00000100:00100000:3.0:1787134901.155092:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:3.0:1787134901.155101:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+12:13791:x1873946287916032:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787134901.155118:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134901.155135:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae907237 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd233841ac907074f expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134901.155198:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae907237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907074f expref: 13 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134901.155216:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa7fa7bc00/0x69932dacae907237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907074f expref: 13 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134901.155226:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7bc00, rc 0) 00000100:00100000:3.0:1787134901.155275:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13791:x1873946287916032:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 175us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134901.155282:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:3.0:1787134901.165615:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134901.165690:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287916160 00000100:00100000:1.0:1787134901.165701:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287916160 00000100:00100000:1.0:1787134901.166437:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:1.0:1787134901.166449:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13791:x1873946287916160:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787134901.166755:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13791:x1873946287916160:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 308us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134901.166764:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:1.0:1787134901.168868:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134901.169583:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287916288 00000100:00100000:3.0:1787134901.169594:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287916288 00000100:00100000:3.0:1787134901.169688:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:3.0:1787134901.169700:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13791:x1873946287916288:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787134901.169924:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:13791:x1873946287916288:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 225us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134901.169932:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 120 00010000:00010000:3.0:1787134901.568397:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134902.004338:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134902.004394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134902.004427:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134902.004708:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287916800 00000100:00100000:1.0:1787134902.004720:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287916800 00000100:00100000:1.0:1787134902.004777:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287917056 00000100:00100000:1.0:1787134902.004781:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287917056 00000100:00100000:1.0:1787134902.004803:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:1.0:1787134902.004815:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2350:x1873946287916800:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134902.004906:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2350:x1873946287916800:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 93us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134902.004915:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:1.0:1787134902.004932:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787134902.004939:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2350:x1873946287917056:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134902.004964:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2350:x1873946287917056:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134902.004970:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:0.0:1787134902.005599:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287916544 00000100:00100000:0.0:1787134902.005607:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287916544 00000100:00100000:0.0:1787134902.005644:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:0.0:1787134902.005652:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2350:x1873946287916544:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787134902.005705:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2350:x1873946287916544:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 54us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134902.005712:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00080000:3.0:1787134902.008540:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787134902.008551:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787134902.008554:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134902.026698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134902.026744:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134902.026782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134902.026815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134902.026865:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287916672 00000100:00100000:3.0:1787134902.026875:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287916672 00000100:00100000:3.0:1787134902.026933:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287917184 00000100:00100000:3.0:1787134902.026937:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287917184 00000100:00100000:3.0:1787134902.026959:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:3.0:1787134902.026968:0:15153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2350:x1873946287916672:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134902.027043:0:15153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2350:x1873946287916672:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 75us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134902.027051:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:3.0:1787134902.027067:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:3.0:1787134902.027074:0:15153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2350:x1873946287917184:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134902.027100:0:15153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2350:x1873946287917184:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134902.027106:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00080000:3.0:1787134902.027122:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787134902.027126:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134902.027412:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287916928 00000100:00100000:2.0:1787134902.027417:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287916928 00000100:00100000:2.0:1787134902.027479:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:2.0:1787134902.027487:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:2350:x1873946287916928:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134902.027524:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:2350:x1873946287916928:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 38us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134902.027530:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:1.0:1787134902.027626:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287916416 00000100:00100000:1.0:1787134902.027631:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287916416 00000100:00100000:1.0:1787134902.027668:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:1.0:1787134902.027676:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:2350:x1873946287916416:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787134902.027708:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:2350:x1873946287916416:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134902.027715:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00080000:3.0:1787134902.027954:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787134902.593207:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134903.616500:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134904.197007:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312031872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134904.197120:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134904.197281:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312031872 00000100:00100000:1.0:1787134904.197291:0:15155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312031872 00000100:00100000:1.0:1787134904.197370:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787134904.197382:0:15155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312031872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134904.197431:0:15155:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134904.197502:0:15155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873946312031872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134904.197510:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787134904.197568:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1873946312031872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787134904.197909:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787134904.385836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134904.385977:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287917312 00000100:00100000:0.0:1787134904.385991:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287917312 00000100:00100000:0.0:1787134904.386072:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:0.0:1787134904.386084:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+6:14450:x1873946287917312:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134904.386105:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134904.386127:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90723e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070756 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.386237:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.386256:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.386271:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.386287:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.386294:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.386301:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387072:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae907253 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387085:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae907253 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387092:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae907253 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134904.387190:0:16342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787134904.387194:0:16342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134904.387294:0:16342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae907253 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387306:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387312:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387318:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387325:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134904.387330:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387338:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387348:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531acf00) 00010000:00010000:0.0:1787134904.387356:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134904.387361:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387366:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae907245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387379:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387386:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387392:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387396:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134904.387399:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387405:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387412:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98aa531ac700) 00010000:00010000:0.0:1787134904.387414:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134904.387416:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387421:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae90724c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387470:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90723e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070756 expref: 8 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387495:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450e00/0x69932dacae907253 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070756 expref: 7 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.387502:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98aa531acb00) 00010000:00010000:0.0:1787134904.387505:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787134904.387507:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450e00, rc 0) 00000100:00080000:3.0:1787134904.388306:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134904.389478:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+7:14450:x1873946287917312:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 3386us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134904.389490:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:3.0:1787134904.404326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134904.404618:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287917568 00000100:00100000:2.0:1787134904.404630:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287917568 00000100:00100000:2.0:1787134904.404693:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787134904.404703:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+7:14450:x1873946287917568:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134904.404725:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134904.404747:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90725a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907075d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.404947:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.404964:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.404977:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.405044:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.405052:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.405060:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.413194:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae90726f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.413220:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae90726f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.413241:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae90726f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134904.413257:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787134904.420491:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420513:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420521:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420527:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134904.420533:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420869:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420886:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98aa531acb00) 00010000:00010000:2.0:1787134904.420889:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134904.420894:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420900:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae907261 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420919:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420925:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420949:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420955:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134904.420957:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420963:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420971:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98aa59e99300) 00010000:00010000:2.0:1787134904.420973:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134904.420975:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.420981:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907268 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.421517:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90725a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907075d expref: 10 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.421549:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96c00/0x69932dacae90726f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907075d expref: 9 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.421558:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa59e99100) 00010000:00010000:2.0:1787134904.421560:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134904.421562:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96c00, rc 0) 00000100:00100000:2.0:1787134904.426990:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14450:x1873946287917568:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 22275us (22667us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787134904.427025:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:3.0:1787134904.437023:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134904.440102:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287917696 00000100:00100000:1.0:1787134904.440117:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287917696 00000100:00100000:1.0:1787134904.440220:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:1.0:1787134904.440231:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14450:x1873946287917696:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787134904.440365:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14450:x1873946287917696:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 Request processed in 136us (3352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134904.440373:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:1.0:1787134904.465422:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134904.465558:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287917824 00000100:00100000:0.0:1787134904.465569:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287917824 00000100:00100000:0.0:1787134904.465636:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:0.0:1787134904.465647:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14456:x1873946287917824:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134904.465669:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134904.465688:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90727d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070764 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.465756:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.465892:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.465905:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.465920:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.465944:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.465949:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466533:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466600:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466607:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466613:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134904.466618:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466626:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466640:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531acf00) 00010000:00010000:0.0:1787134904.466643:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134904.466648:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466654:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae907284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466667:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466681:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466687:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466692:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134904.466696:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466702:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466711:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98aa531ac700) 00010000:00010000:0.0:1787134904.466713:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134904.466715:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466720:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae90728b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466755:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90727d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070764 expref: 10 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.466765:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531acf00) 00010000:00010000:0.0:1787134904.467953:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134904.467965:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae90727d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070764 expref: 10 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.467997:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450000, rc 0) 00000100:00100000:0.0:1787134904.468078:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14456:x1873946287917824:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 2432us (2693us total) trans 0 rc 301/301 00000100:00100000:0.0:1787134904.468087:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:3.0:1787134904.476938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134904.477122:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287917952 00000100:00100000:1.0:1787134904.477134:0:14475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287917952 00000100:00100000:1.0:1787134904.477235:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787134904.477246:0:14475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14456:x1873946287917952:12345-192.168.202.36@tcp:700:lfs.0 00000100:00100000:1.0:1787134904.477344:0:14475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14456:x1873946287917952:12345-192.168.202.36@tcp:700:lfs.0 Request processed in 100us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134904.477352:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:3.0:1787134904.479529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134904.481629:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287918208 00000100:00100000:1.0:1787134904.481662:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287918208 00000100:00100000:1.0:1787134904.481743:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:1.0:1787134904.481754:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14456:x1873946287918208:12345-192.168.202.36@tcp:36:lfs.0 00010000:00010000:1.0:1787134904.481818:0:14467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134904.481848:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9071c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90706df expref: 9 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.481869:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531acf00) 00010000:00010000:1.0:1787134904.481874:0:14467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787134904.482235:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.482250:0:14467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070741 expref: 5 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.482259:0:14467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.482297:0:14467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070741 expref: 5 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.482311:0:14467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070741 expref: 5 pid: 14467 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134904.482327:0:14467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14467:1873946312032000:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134904.482427:0:14467:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa47320840 going to sleep for 11 seconds 00000100:00100000:3.0:1787134904.485434:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134904.485479:0:14467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14467:1873946312032000:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134904.485514:0:14467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134904.485603:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287918336 00000100:00100000:2.0:1787134904.485610:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287918336 00010000:00010000:2.0:1787134904.485659:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070741 expref: 6 pid: 14467 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134904.485704:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:2.0:1787134904.485714:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:2351:x1873946287918336:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134904.485732:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134904.485739:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070741 expref: 6 pid: 14467 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.485751:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070741 expref: 6 pid: 14467 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.485776:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae9071f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070741 expref: 6 pid: 14467 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.485793:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531acf00) 00010000:00010000:2.0:1787134904.485797:0:14452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.485807:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.485815:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.485853:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134904.485905:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2351:x1873946287918336:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 192us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134904.485913:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00080000:3.0:1787134904.485941:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787134904.486137:0:14467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.486145:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.486205:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.486215:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.486223:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134904.487627:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787134904.487643:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.487653:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.487660:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.487666:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134904.487671:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.487679:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.487703:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531acf00) 00010000:00010000:1.0:1787134904.487706:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134904.487710:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.487717:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907292 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134904.487739:0:14467:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000a45ed2e9 reply state 00000000f3d9b758 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134904.487748:0:14467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787134904.487852:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+10:14456:x1873946287918208:12345-192.168.202.36@tcp:36:lfs.0 Request processed in 6097us (8330us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787134904.487861:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00010000:00010000:1.0:1787134904.490610:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.490630:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.490638:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.490645:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134904.490649:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.490657:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.490697:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98aa50adec00) 00010000:00010000:1.0:1787134904.490700:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134904.490705:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.490712:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907299 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134904.637606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134904.637718:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287918464 00000100:00100000:0.0:1787134904.637729:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287918464 00000100:00100000:0.0:1787134904.637792:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:0.0:1787134904.637802:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14464:x1873946287918464:12345-192.168.202.36@tcp:101:lctl.0 00010000:00010000:0.0:1787134904.637832:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134904.637859:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907076b expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.637929:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9072a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.637945:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9072a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.637958:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9072a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134904.638300:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787134904.638305:0:14468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134904.638354:0:14468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9072a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.638378:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907076b expref: 11 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.638417:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451e00/0x69932dacae9072a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907076b expref: 10 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.638426:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:0.0:1787134904.638429:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787134904.638432:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451e00, rc 0) 00000100:00100000:0.0:1787134904.638510:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+10:14464:x1873946287918464:12345-192.168.202.36@tcp:101:lctl.0 Request processed in 710us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134904.638518:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00010000:00010000:3.0:1787134904.640413:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787134904.682059:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134904.682183:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287918592 00000100:00100000:0.0:1787134904.682194:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287918592 00000100:00100000:0.0:1787134904.682260:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:0.0:1787134904.682271:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:14465:x1873946287918592:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134904.682294:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134904.682317:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070772 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.682385:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae9072b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.682402:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae9072b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.682414:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae9072b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134904.682487:0:16342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787134904.682503:0:16342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134904.682532:0:16342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae9072b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.682556:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070772 expref: 7 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.682575:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451600/0x69932dacae9072b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070772 expref: 6 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.682584:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:0.0:1787134904.682587:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787134904.682590:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451600, rc 0) 00000100:00100000:0.0:1787134904.682657:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:14465:x1873946287918592:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 388us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134904.682665:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:3.0:1787134904.689003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134904.689145:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287918720 00000100:00100000:2.0:1787134904.689198:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287918720 00000100:00100000:2.0:1787134904.689255:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:2.0:1787134904.689265:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+6:14465:x1873946287918720:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134904.689286:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134904.689307:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9072bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070779 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689372:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689387:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689398:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689414:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689420:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689426:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689605:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689614:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689621:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134904.689660:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787134904.689664:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134904.689693:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689704:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689723:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689729:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689735:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134904.689739:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689746:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689758:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:2.0:1787134904.689766:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134904.689772:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689778:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689793:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689799:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689805:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689809:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134904.689812:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689817:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689824:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98aa59e99300) 00010000:00010000:2.0:1787134904.689826:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134904.689828:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689833:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689862:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae9072bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070779 expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689888:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070779 expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.689895:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:2.0:1787134904.689898:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787134904.689900:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa97a00, rc 0) 00000100:00100000:2.0:1787134904.690276:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+7:14465:x1873946287918720:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 702us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134904.690287:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:2.0:1787134904.694867:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134904.695078:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287918976 00000100:00100000:0.0:1787134904.695089:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287918976 00000100:00100000:0.0:1787134904.695190:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:0.0:1787134904.695203:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+7:14465:x1873946287918976:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787134904.695225:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134904.695245:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070780 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134904.695369:0:16342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787134904.695504:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070780 expref: 9 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.695518:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:0.0:1787134904.695534:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787134904.695541:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070780 expref: 9 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.695556:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81450000, rc 0) 00000100:00100000:0.0:1787134904.695621:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+8:14465:x1873946287918976:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 421us (764us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787134904.695629:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:2.0:1787134904.705725:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787134904.705752:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312032128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787134904.705902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787134904.706009:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312032128 00000100:00100000:2.0:1787134904.706017:0:15155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312032128 00000100:00100000:2.0:1787134904.706901:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787134904.706916:0:15155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312032128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787134904.706952:0:15155:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787134904.707017:0:15155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312032128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1115us total) trans 0 rc 0/0 00000100:00080000:3.0:1787134904.707801:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134904.707992:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946312032384:0@lo:400:kworker.0 00000100:00100000:0.0:1787134904.708146:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1873946312032640:0@lo:400:kworker.0 00000100:00100000:0.0:1787134904.709080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134904.709139:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787134904.709149:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312032256:0@lo:400:kworker.0 00000100:00100000:0.0:1787134904.709205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134904.709249:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312032640 00000100:00100000:0.0:1787134904.709255:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312032640 00000100:00100000:1.0:1787134904.709552:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312032512:0@lo:400:kworker.0 00000100:00100000:1.0:1787134904.709584:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134904.709693:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312032128:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787134904.709777:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134904.709888:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312032512 00000100:00100000:0.0:1787134904.709893:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312032512 00000100:00080000:0.0:1787134904.709913:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787134904.709928:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787134904.709939:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873946312032640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787134904.709970:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787134904.709980:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312032512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134904.710000:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873946312032640:12345-0@lo:400:kworker.0 Request processed in 62us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134904.710008:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787134904.710026:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312032512:12345-0@lo:400:kworker.0 Request processed in 48us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134904.710035:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787134904.710062:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312032512:0@lo:400:kworker.0 00000100:00100000:0.0:1787134904.710114:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1873946312032640:0@lo:400:kworker.0 00000100:00100000:1.0:1787134904.710134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134904.710153:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287919232 00000100:00100000:0.0:1787134904.710182:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287919232 00000100:00100000:0.0:1787134904.710227:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:0.0:1787134904.710234:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+8:14465:x1873946287919232:12345-192.168.202.36@tcp:36:lfs.0 00000100:00100000:2.0:1787134904.710492:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787134904.710536:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312032256 00000100:00100000:2.0:1787134904.710541:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312032256 00000100:00100000:2.0:1787134904.710572:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787134904.710580:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:3307:x1873946312032256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787134904.710756:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:787f8101-2629-402b-af83-ff6c365f26f7+19:3307:x1873946312032256:12345-0@lo:400:kworker.0 Request processed in 176us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134904.710765:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787134904.710918:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134904.710971:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312032384 00000100:00100000:3.0:1787134904.710975:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312032384 00000100:00100000:3.0:1787134904.711011:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787134904.711018:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946312032384:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1787134904.711179:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134904.711210:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070779 expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.711229:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa59e99800) 00010000:00010000:0.0:1787134904.711242:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134904.711513:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312032256:0@lo:400:kworker.0 00000100:00100000:3.0:1787134904.711711:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873946312032384:12345-0@lo:400:kworker.0 Request processed in 693us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134904.711719:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787134904.711787:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134904.711801:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134904.713975:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873946312032384:0@lo:400:kworker.0 00010000:00010000:0.0:1787134904.717884:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787134904.720787:0:14466:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000555a49e1 reply state 000000002d17f5ad transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134904.720804:0:14466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787134904.721197:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787134904.721304:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+9:14465:x1873946287919232:12345-192.168.202.36@tcp:36:lfs.0 Request processed in 11065us (11168us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787134904.721314:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 24 00010000:00010000:3.0:1787134904.724565:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134904.724579:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134904.724588:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134904.724594:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81450000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134904.724598:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134904.724606:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134904.724626:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa531acf00) 00010000:00010000:3.0:1787134904.724630:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787134904.724634:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134904.724657:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9072e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134904.737615:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134904.737754:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287919488 00000100:00100000:2.0:1787134904.737767:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287919488 00000100:00100000:2.0:1787134904.737837:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:2.0:1787134904.737847:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+8:14465:x1873946287919488:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787134904.738292:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+9:14465:x1873946287919488:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 444us (683us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787134904.738300:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:2.0:1787134904.744212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134904.744254:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287919744 00000100:00100000:2.0:1787134904.744277:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287919744 00000100:00100000:2.0:1787134904.744499:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:2.0:1787134904.744511:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+9:14465:x1873946287919744:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134904.744543:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134904.744566:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070787 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.744965:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.744981:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.745007:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.745023:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.745030:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.745144:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134904.746386:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787134904.746551:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746561:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746569:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746575:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134904.746580:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746587:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746601:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:2.0:1787134904.746604:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134904.746614:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746621:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9072f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746755:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746762:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746769:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746774:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134904.746778:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746783:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746791:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98aa59e99300) 00010000:00010000:2.0:1787134904.746794:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134904.746796:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746801:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9072fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746919:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070787 expref: 11 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746945:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:2.0:1787134904.746948:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134904.746952:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae9072ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070787 expref: 11 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.746963:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96600, rc 0) 00000100:00100000:2.0:1787134904.747037:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+10:14465:x1873946287919744:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 2528us (2835us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787134904.747046:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:1.0:1787134904.753214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134904.754745:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287919872 00000100:00100000:1.0:1787134904.754759:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287919872 00000100:00100000:1.0:1787134904.754956:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:1.0:1787134904.754968:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+10:14465:x1873946287919872:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134904.754993:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134904.755023:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907309 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907078e expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.755117:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.755132:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.755144:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134904.755324:0:16342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787134904.755329:0:16342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134904.755409:0:16342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.755446:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907309 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907078e expref: 12 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.755463:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907078e expref: 11 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.755471:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:1.0:1787134904.755474:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787134904.755477:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6800, rc 0) 00000100:00100000:1.0:1787134904.755540:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+11:14465:x1873946287919872:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 575us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134904.755547:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:0.0:1787134904.763526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134904.763607:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287920000 00000100:00100000:1.0:1787134904.763630:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287920000 00000100:00100000:1.0:1787134904.763690:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:1.0:1787134904.763698:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+11:14465:x1873946287920000:12345-192.168.202.36@tcp:37:lfs.0 00000100:00100000:3.0:1787134904.770773:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+11:14465:x1873946287920000:12345-192.168.202.36@tcp:37:lfs.0 Request processed in 7063us (7244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134904.770789:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:0.0:1787134904.774288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134904.774372:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287920256 00000100:00100000:3.0:1787134904.774383:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287920256 00000100:00100000:3.0:1787134904.774454:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:3.0:1787134904.774465:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+11:14465:x1873946287920256:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787134904.774929:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+12:14465:x1873946287920256:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 465us (650us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787134904.774938:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000001:00080000:3.0:1787134904.783463:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:3.0:1787134904.783482:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000100:00100000:1.0:1787134904.856518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134904.856875:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287920384 00000100:00100000:2.0:1787134904.856887:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287920384 00000100:00100000:2.0:1787134904.856987:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:2.0:1787134904.856998:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+8:14471:x1873946287920384:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134904.857019:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134904.857047:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907317 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070795 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.857107:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.857129:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.857139:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.857153:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.857210:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.857217:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858025:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae90732c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858214:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae90732c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858223:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae90732c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134904.858314:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787134904.858318:0:14468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134904.858799:0:14468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae90732c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858824:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858831:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858839:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858845:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134904.858850:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858866:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858880:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:2.0:1787134904.858883:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134904.858888:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858894:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90731e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858908:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858914:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858921:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858926:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134904.858928:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858933:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858939:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98aa59e99300) 00010000:00010000:2.0:1787134904.858942:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134904.858944:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.858958:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907325 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.859001:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907317 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070795 expref: 10 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.859016:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96400/0x69932dacae90732c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070795 expref: 9 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.859024:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:2.0:1787134904.859027:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787134904.859029:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96400, rc 0) 00000100:00100000:2.0:1787134904.859404:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14471:x1873946287920384:12345-192.168.202.36@tcp:101:bash.0 Request processed in 2407us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134904.859414:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:0.0:1787134904.870415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134904.871274:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287920640 00000100:00100000:1.0:1787134904.871287:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287920640 00000100:00100000:1.0:1787134904.871617:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:1.0:1787134904.871637:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+9:14471:x1873946287920640:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134904.871662:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134904.871686:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907333 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907079c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.872741:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.872766:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907078e expref: 10 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.872776:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.872882:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907078e expref: 10 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.872899:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907078e expref: 10 pid: 16342 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134904.872916:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14466:1873946312032768:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787134904.873183:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9434550c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787134904.878959:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134904.879961:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287920768 00000100:00100000:2.0:1787134904.879974:0:14453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287920768 00010000:00010000:2.0:1787134904.880025:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907078e expref: 11 pid: 16342 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134904.880071:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:2.0:1787134904.880082:0:14453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+11:2352:x1873946287920768:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134904.880098:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134904.880106:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907078e expref: 11 pid: 16342 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.880155:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907078e expref: 11 pid: 16342 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.880226:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:2.0:1787134904.880232:0:14453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.880244:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.880253:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134904.880291:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134904.880369:0:14453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+11:2352:x1873946287920768:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 289us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134904.880377:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00010000:00010000:1.0:1787134904.885018:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6800/0x69932dacae907310 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907078e expref: 10 pid: 16342 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134904.885215:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa73cc5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14466:1873946312032768:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787134904.885245:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.885257:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.885263:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.885312:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.885568:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.885581:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889100:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889248:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889263:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134904.889288:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787134904.889316:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889384:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889399:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889410:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134904.889415:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889617:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889694:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:1.0:1787134904.889697:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134904.889702:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889709:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae90733a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787134904.889723:0:14466:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000004d4efa60 reply state 00000000af66e4f0 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134904.889730:0:14466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787134904.889768:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae907333 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907079c expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889796:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907079c expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.889803:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:1.0:1787134904.889806:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787134904.889808:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe7600, rc 0) 00000100:00100000:1.0:1787134904.890048:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+12:14471:x1873946287920640:12345-192.168.202.36@tcp:101:bash.0 Request processed in 18413us (19642us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787134904.890057:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 28 00010000:00010000:1.0:1787134904.894478:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.894500:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.894509:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.894516:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa6fbe6200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134904.894521:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.894530:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.894547:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98aa50ade900) 00010000:00010000:1.0:1787134904.894551:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134904.894556:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.894579:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907341 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787134904.899120:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787134904.915259:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134904.915373:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287920896 00000100:00100000:1.0:1787134904.915383:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287920896 00000100:00100000:1.0:1787134904.915462:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:1.0:1787134904.915473:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+11:14471:x1873946287920896:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134904.915498:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134904.915528:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907356 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707a3 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.915594:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae90735d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.915609:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae90735d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.915633:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae90735d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134904.915673:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787134904.915677:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787134904.915694:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae90735d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.915704:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae90735d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.915727:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907356 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707a3 expref: 13 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.915767:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae90735d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707a3 expref: 12 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134904.915776:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:1.0:1787134904.915778:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134904.915782:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6e00, rc 0) 00000100:00100000:1.0:1787134904.915837:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+12:14471:x1873946287920896:12345-192.168.202.36@tcp:101:bash.0 Request processed in 366us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134904.915844:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:0.0:1787134904.923628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134904.923740:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287921152 00000100:00100000:3.0:1787134904.923751:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287921152 00000100:00100000:3.0:1787134904.923850:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787134904.923861:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+12:14471:x1873946287921152:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:3.0:1787134904.924268:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+13:14471:x1873946287921152:12345-192.168.202.36@tcp:35:bash.0 Request processed in 408us (650us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787134904.924277:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:2.0:1787134905.014691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134905.014796:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287921408 00000100:00100000:1.0:1787134905.014807:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287921408 00000100:00100000:1.0:1787134905.014870:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:1.0:1787134905.014880:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+13:14481:x1873946287921408:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134905.014903:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134905.014921:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707aa expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134905.015048:0:16342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787134905.015200:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907364 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707aa expref: 15 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134905.015214:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:1.0:1787134905.015217:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787134905.015222:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707aa expref: 15 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134905.015256:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6200, rc 0) 00000100:00100000:1.0:1787134905.015317:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+14:14481:x1873946287921408:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 439us (635us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787134905.015324:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:0.0:1787134905.022404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134905.025004:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287921664 00000100:00100000:1.0:1787134905.025020:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287921664 00000100:00100000:1.0:1787134905.025911:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:1.0:1787134905.025927:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+14:14481:x1873946287921664:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787134905.026763:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+15:14481:x1873946287921664:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 837us (4375us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787134905.026774:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:2.0:1787134905.071016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134905.071598:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287921920 00000100:00100000:1.0:1787134905.071612:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287921920 00000100:00100000:1.0:1787134905.071732:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:1.0:1787134905.071744:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+15:14484:x1873946287921920:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787134905.071772:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134905.071796:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907372 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707b1 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134905.071910:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907379 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134905.071926:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907379 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134905.071943:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907379 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787134905.071973:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787134905.072136:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6200/0x69932dacae907372 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707b1 expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134905.072211:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907379 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707b1 expref: 17 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134905.072222:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:1.0:1787134905.072225:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787134905.072229:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6c00, rc 0) 00000100:00100000:1.0:1787134905.072623:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+17:14484:x1873946287921920:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 882us (1621us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787134905.072633:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:0.0:1787134905.078191:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134905.083659:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287922176 00000100:00100000:2.0:1787134905.083674:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287922176 00000100:00100000:2.0:1787134905.083738:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:2.0:1787134905.083747:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+17:14484:x1873946287922176:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787134905.083819:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.083837:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.083867:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.083897:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.083905:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.083912:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.083918:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134905.083923:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.083931:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.083943:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:2.0:1787134905.083946:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134905.083951:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.083957:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907387 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134905.084577:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+17:14484:x1873946287922176:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 825us (6417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134905.084585:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:1.0:1787134905.087937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134905.087983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134905.088058:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287922432 00000100:00100000:3.0:1787134905.088068:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287922432 00000100:00100000:3.0:1787134905.088118:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787134905.088128:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+17:14484:x1873946287922432:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787134905.088587:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+18:14484:x1873946287922432:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 458us (601us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787134905.088595:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:2.0:1787134905.089139:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287922048 00000100:00100000:2.0:1787134905.089146:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287922048 00000100:00100000:2.0:1787134905.089208:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:2.0:1787134905.089216:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+18:2352:x1873946287922048:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134905.089229:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134905.089252:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6c00/0x69932dacae907379 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707b1 expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.089284:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:2.0:1787134905.089290:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134905.089335:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa73cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+17:2352:x1873946287922048:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 119us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134905.089342:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787134905.536785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134905.537285:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287922688 00000100:00100000:2.0:1787134905.537297:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287922688 00000100:00100000:2.0:1787134905.537372:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787134905.537629:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+17:14516:x1873946287922688:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:2.0:1787134905.537654:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134905.537675:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90738e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707b8 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.537774:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907395 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.537789:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.537801:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134905.537831:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787134905.537983:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae90738e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707b8 expref: 20 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.538004:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907395 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707b8 expref: 19 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.538012:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:2.0:1787134905.538015:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134905.538018:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96600, rc 0) 00000100:00100000:2.0:1787134905.542571:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+19:14516:x1873946287922688:12345-192.168.202.36@tcp:101:cat.0 Request processed in 5174us (5782us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787134905.542586:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787134905.558626:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134905.559921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134905.560255:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287923072 00000100:00100000:3.0:1787134905.560265:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287923072 00000100:00100000:3.0:1787134905.560333:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:3.0:1787134905.560345:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+19:14516:x1873946287923072:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:1.0:1787134905.560898:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287922816 00000100:00100000:1.0:1787134905.560905:0:14453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287922816 00000100:00100000:1.0:1787134905.560956:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:1.0:1787134905.560964:0:14453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+21:2351:x1873946287922816:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134905.560977:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134905.561002:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907395 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707b8 expref: 21 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134905.561023:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:1.0:1787134905.561028:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134905.564679:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+20:14516:x1873946287923072:12345-192.168.202.36@tcp:35:cat.0 Request processed in 4321us (4748us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787134905.564694:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:1.0:1787134905.572552:0:14453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+19:2351:x1873946287922816:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 11577us (13924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134905.572570:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00010000:00010000:0.0:1787134905.664695:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134905.693678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134905.693830:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287923328 00000100:00100000:0.0:1787134905.693841:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287923328 00000100:00100000:0.0:1787134905.693908:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:0.0:1787134905.693918:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+19:14522:x1873946287923328:12345-192.168.202.36@tcp:101:dd.0 00010000:00010000:0.0:1787134905.693945:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134905.693968:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9073a3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707bf expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134905.694077:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134905.694092:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134905.694104:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134905.694118:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787134905.694326:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9073a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707bf expref: 22 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134905.694346:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707bf expref: 21 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134905.694376:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:0.0:1787134905.694389:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134905.694393:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa81451400, rc 0) 00000100:00100000:0.0:1787134905.694460:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+21:14522:x1873946287923328:12345-192.168.202.36@tcp:101:dd.0 Request processed in 544us (793us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787134905.694467:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:0.0:1787134905.700826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134905.700930:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287923584 00000100:00100000:2.0:1787134905.700942:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287923584 00000100:00100000:2.0:1787134905.701052:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:2.0:1787134905.701062:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+21:14522:x1873946287923584:12345-192.168.202.36@tcp:36:dd.0 00010000:00010000:2.0:1787134905.701131:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787134905.701192:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707bf expref: 21 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.701216:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe6e00/0x69932dacae90735d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707a3 expref: 20 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.701246:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:2.0:1787134905.701251:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134905.701971:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.701988:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134905.701998:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787134905.702060:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787134905.702085:0:14466:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000ca3037fb reply state 00000000baf06631 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134905.702093:0:14466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134905.702688:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+22:14522:x1873946287923584:12345-192.168.202.36@tcp:36:dd.0 Request processed in 1623us (1867us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787134905.702699:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000020:00080000:2.0:1787134905.702705:0:14466:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787134905.712197:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134905.712220:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134905.712228:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134905.712235:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134905.712241:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134905.712249:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134905.712269:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:3.0:1787134905.712272:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134905.712296:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134905.712303:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae9073b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134905.789038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134905.789146:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287923840 00000100:00100000:1.0:1787134905.789156:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287923840 00000100:00100000:1.0:1787134905.789288:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787134905.789298:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+21:14522:x1873946287923840:12345-192.168.202.36@tcp:35:dd.0 00000100:00100000:1.0:1787134905.789780:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+22:14522:x1873946287923840:12345-192.168.202.36@tcp:35:dd.0 Request processed in 482us (751us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1787134905.789789:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787134906.033396:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134906.034784:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287923968 00000100:00100000:0.0:1787134906.034798:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287923968 00000100:00100000:0.0:1787134906.034890:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:0.0:1787134906.034902:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+22:14536:x1873946287923968:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:0.0:1787134906.034928:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134906.034949:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9073bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707c6 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035025:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035040:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035053:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035068:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035093:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035100:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035241:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670e00/0x69932dacae9073d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035250:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670e00/0x69932dacae9073d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035258:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670e00/0x69932dacae9073d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134906.035304:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787134906.035308:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134906.035360:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670e00/0x69932dacae9073d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035372:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670e00/0x69932dacae9073d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035393:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035400:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035406:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035423:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134906.035437:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035445:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035458:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:0.0:1787134906.035462:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134906.035467:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035473:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451400/0x69932dacae9073c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035488:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035494:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035500:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035505:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa81451a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134906.035508:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787134906.035509:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787134906.035514:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035531:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98aa531ac500) 00010000:00010000:0.0:1787134906.035534:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134906.035537:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035543:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81451a00/0x69932dacae9073cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035575:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa81450000/0x69932dacae9073bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707c6 expref: 24 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035589:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670e00/0x69932dacae9073d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707c6 expref: 23 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.035597:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:0.0:1787134906.035599:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134906.035601:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa41670e00, rc 0) 00000100:00100000:0.0:1787134906.035672:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+23:14536:x1873946287923968:12345-192.168.202.36@tcp:101:stat.0 Request processed in 773us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134906.035681:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:0.0:1787134906.188833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134906.189204:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287924224 00000100:00100000:3.0:1787134906.189217:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287924224 00000100:00100000:3.0:1787134906.189282:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:3.0:1787134906.189294:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+23:14542:x1873946287924224:12345-192.168.202.36@tcp:36:truncate.0 00010000:00010000:3.0:1787134906.189354:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134906.189382:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670e00/0x69932dacae9073d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707c6 expref: 23 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.189414:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:3.0:1787134906.189420:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787134906.189652:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.189669:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.189680:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787134906.189748:0:14468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1787134906.189778:0:14468:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000fe1a105d reply state 00000000de2da81f transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134906.189787:0:14468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787134906.189912:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+25:14542:x1873946287924224:12345-192.168.202.36@tcp:36:truncate.0 Request processed in 620us (1088us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787134906.189934:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00000020:00080000:3.0:1787134906.189940:0:14468:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787134906.204909:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134906.204928:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134906.204936:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134906.204941:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1787134906.204947:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134906.205106:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134906.205124:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:1.0:1787134906.205128:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787134906.205701:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134906.205711:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073db lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134906.432809:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134906.433016:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287924352 00000100:00100000:3.0:1787134906.433039:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287924352 00000100:00100000:3.0:1787134906.433100:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:3.0:1787134906.433110:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+24:14556:x1873946287924352:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:3.0:1787134906.433137:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134906.433186:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae9073e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707cd expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433263:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433279:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433291:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433307:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433324:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433331:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433446:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433471:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433478:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134906.433527:0:16342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1787134906.433532:0:16342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787134906.433553:0:16342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433565:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433575:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433581:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433588:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433593:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ae00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134906.433597:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433604:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433617:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:3.0:1787134906.433625:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134906.433631:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433638:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9073e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433653:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433659:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433665:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433670:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134906.433672:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433678:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433685:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98aa59fa6300) 00010000:00010000:3.0:1787134906.433688:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134906.433690:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433695:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae9073f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433726:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae9073e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707cd expref: 26 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433753:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707cd expref: 25 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.433760:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:3.0:1787134906.433763:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787134906.433765:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b400, rc 0) 00000100:00100000:3.0:1787134906.433835:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+25:14556:x1873946287924352:12345-192.168.202.36@tcp:101:stat.0 Request processed in 725us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134906.433842:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:3.0:1787134906.590592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134906.591011:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287924608 00000100:00100000:2.0:1787134906.591031:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287924608 00000100:00100000:2.0:1787134906.591093:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:2.0:1787134906.591103:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+25:14566:x1873946287924608:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134906.591126:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134906.591146:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9073fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707d4 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134906.591322:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787134906.591464:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9073fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707d4 expref: 27 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.591479:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:2.0:1787134906.591482:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134906.591487:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae9073fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707d4 expref: 27 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.591513:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96000, rc 0) 00000100:00100000:2.0:1787134906.591583:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+26:14566:x1873946287924608:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 481us (1002us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1787134906.591591:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:1.0:1787134906.595604:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134906.595758:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287924864 00000100:00100000:3.0:1787134906.595771:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287924864 00000100:00100000:3.0:1787134906.595831:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:3.0:1787134906.595843:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+26:14566:x1873946287924864:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787134906.596125:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+27:14566:x1873946287924864:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 283us (529us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787134906.596132:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787134906.685068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134906.685267:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287925120 00000100:00100000:3.0:1787134906.685279:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287925120 00000100:00100000:3.0:1787134906.685358:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:3.0:1787134906.685369:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+27:14572:x1873946287925120:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787134906.685407:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134906.685438:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae90740c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707db expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.685816:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.685833:0:16342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907079c expref: 28 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.685842:0:16342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707cd expref: 28 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.685851:0:16342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.685888:0:16342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707cd expref: 28 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.685903:0:16342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707cd expref: 28 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134906.685918:0:16342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd56680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16342:1873946312032896:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134906.686098:0:16342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907079c expref: 28 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.686108:0:16342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907079c expref: 28 pid: 14466 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134906.686118:0:16342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16342:1873946312033024:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787134906.686204:0:16342:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa812f6540 going to sleep for 11 seconds 00010000:00010000:2.0:1787134906.689415:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134906.703955:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134906.704007:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134906.706705:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287925248 00000100:00100000:0.0:1787134906.706722:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287925248 00010000:00010000:0.0:1787134906.706780:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707cd expref: 29 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134906.706827:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287925376 00000100:00100000:0.0:1787134906.706846:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287925376 00010000:00010000:0.0:1787134906.706861:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907079c expref: 30 pid: 14466 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134906.706888:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:0.0:1787134906.706899:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa764e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+30:2352:x1873946287925248:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134906.706917:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134906.706924:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707cd expref: 30 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.706938:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707cd expref: 30 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.706962:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:0.0:1787134906.706967:0:14452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.706976:0:14452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.706983:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134906.707041:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa764e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+30:2352:x1873946287925248:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 144us (3098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134906.707049:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:0.0:1787134906.707104:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:0.0:1787134906.707111:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+29:2352:x1873946287925376:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134906.707119:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134906.707125:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907079c expref: 29 pid: 14466 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.707142:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907079c expref: 29 pid: 14466 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.707155:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:0.0:1787134906.707191:0:14452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.707200:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.707208:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.707227:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134906.707248:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+29:2352:x1873946287925376:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 137us (3241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134906.707255:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00010000:00010000:3.0:1787134906.710297:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae9073f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707cd expref: 28 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134906.710335:0:16342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd56680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16342:1873946312032896:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134906.710353:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa6fbe7600/0x69932dacae907348 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907079c expref: 27 pid: 14466 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134906.710365:0:16342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16342:1873946312033024:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787134906.710399:0:16342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.710411:0:16342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.710417:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134906.710447:0:16342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787134906.711800:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae90740c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707db expref: 28 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.711824:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707db expref: 27 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.711834:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:3.0:1787134906.711837:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787134906.711840:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7a200, rc 0) 00000100:00100000:3.0:1787134906.711931:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+27:14572:x1873946287925120:12345-192.168.202.36@tcp:101:bash.0 Request processed in 26564us (26875us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787134906.711940:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:2.0:1787134906.728084:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134906.728818:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287925632 00000100:00100000:3.0:1787134906.728831:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287925632 00000100:00100000:2.0:1787134906.729042:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:2.0:1787134906.729053:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+27:14572:x1873946287925632:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:2.0:1787134906.729395:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.729415:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.729436:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787134906.729525:0:14468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1787134906.729785:0:14468:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000004b587e23 reply state 00000000e872ea34 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134906.729796:0:14468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134906.729904:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14572:x1873946287925632:12345-192.168.202.36@tcp:36:bash.0 Request processed in 851us (1889us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1787134906.729913:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00000020:00080000:2.0:1787134906.729918:0:14468:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787134906.734440:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.734459:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.734467:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.734472:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134906.734478:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.734494:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.734515:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:3.0:1787134906.734518:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134906.734523:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.734529:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae907421 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134906.737886:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134906.737977:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287925760 00000100:00100000:0.0:1787134906.737990:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287925760 00000100:00100000:0.0:1787134906.738063:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:0.0:1787134906.738073:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+29:14572:x1873946287925760:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787134906.738099:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134906.738119:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670600/0x69932dacae907428 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707e2 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.738218:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670600/0x69932dacae907428 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707e2 expref: 30 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.738252:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670600/0x69932dacae907428 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707e2 expref: 30 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.738273:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:0.0:1787134906.738276:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787134906.738280:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa41670600, rc 0) 00000100:00100000:0.0:1787134906.738342:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14572:x1873946287925760:12345-192.168.202.36@tcp:101:bash.0 Request processed in 269us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134906.738349:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:1.0:1787134906.752221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134906.752588:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287925888 00000100:00100000:0.0:1787134906.752599:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287925888 00000100:00100000:0.0:1787134906.752665:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:0.0:1787134906.752675:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98a942207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14572:x1873946287925888:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787134906.752696:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134906.752716:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90742f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707e9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.752803:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.752818:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707db expref: 31 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.752828:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.752862:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707db expref: 31 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.752892:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707db expref: 31 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134906.752908:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14466:1873946312033152:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134906.753028:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa7bc8fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787134906.758932:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134906.759035:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287926016 00000100:00100000:2.0:1787134906.759045:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287926016 00010000:00010000:2.0:1787134906.759087:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707db expref: 32 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134906.759130:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:2.0:1787134906.759141:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+32:2351:x1873946287926016:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787134906.759199:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134906.759208:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707db expref: 32 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.759221:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707db expref: 32 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.759246:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:2.0:1787134906.759252:0:14452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.759294:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.759313:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.759338:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787134906.759827:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+32:2351:x1873946287926016:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 684us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134906.759837:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00010000:00010000:0.0:1787134906.760877:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a200/0x69932dacae907413 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac90707db expref: 31 pid: 16342 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134906.760912:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14466:1873946312033152:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134906.760938:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.760948:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.760953:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134906.761006:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787134906.761010:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134906.761049:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.761083:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90742f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707e9 expref: 31 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.761100:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707e9 expref: 30 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.761124:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:0.0:1787134906.761126:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787134906.761130:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa41671200, rc 0) 00000100:00100000:0.0:1787134906.762045:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98a942207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14572:x1873946287925888:12345-192.168.202.36@tcp:101:bash.0 Request processed in 9365us (9882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134906.762054:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:1.0:1787134906.769227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134906.769733:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287926272 00000100:00100000:3.0:1787134906.769746:0:14453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287926272 00000100:00100000:3.0:1787134906.769820:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:3.0:1787134906.769846:0:14453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14572:x1873946287926272:12345-192.168.202.36@tcp:103:bash.0 00010000:00010000:3.0:1787134906.769863:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787134906.769889:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671200/0x69932dacae907436 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707e9 expref: 30 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.769912:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670600/0x69932dacae907428 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707e2 expref: 29 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.769924:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa50ade400) 00010000:00010000:3.0:1787134906.769935:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787134906.770059:0:14453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+28:14572:x1873946287926272:12345-192.168.202.36@tcp:103:bash.0 Request processed in 214us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134906.770067:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:3.0:1787134906.776335:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134906.776536:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287926400 00000100:00100000:0.0:1787134906.776558:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287926400 00000100:00100000:0.0:1787134906.776620:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:0.0:1787134906.776630:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+28:14572:x1873946287926400:12345-192.168.202.36@tcp:58:bash.0 00010000:00010000:0.0:1787134906.776739:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.776757:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134906.776769:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787134906.777876:0:14467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787134906.778042:0:14467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787134906.778119:0:14467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787134906.778287:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+28:14572:x1873946287926400:12345-192.168.202.36@tcp:58:bash.0 Request processed in 1653us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134906.778299:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:1.0:1787134906.783942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134906.784060:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287926528 00000100:00100000:2.0:1787134906.784071:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287926528 00000100:00100000:2.0:1787134906.784138:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:2.0:1787134906.784148:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+28:14572:x1873946287926528:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787134906.784203:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134906.784224:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907444 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707f0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.784625:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.784638:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907444 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707f0 expref: 29 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.784656:0:14468:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.784669:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907444 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707f0 expref: 29 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.784698:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa531ac500) 00010000:00010000:2.0:1787134906.784701:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134906.784705:0:14468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907444 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707f0 expref: 29 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.784713:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa96600, rc 0) 00000100:00100000:2.0:1787134906.784776:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+29:14572:x1873946287926528:12345-192.168.202.36@tcp:101:bash.0 Request processed in 630us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134906.784784:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00000040:00080000:0.0:1787134906.944413:0:14498:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787134906.944435:0:14498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134906.944494:0:14498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787134906.944500:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787134906.944624:0:14498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14498:1873946312033280:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787134906.944725:0:14498:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa4133a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787134906.953001:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134906.953245:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287926656 00000100:00100000:2.0:1787134906.953255:0:14477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287926656 00000100:00100000:2.0:1787134906.953316:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:2.0:1787134906.953327:0:14477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14574:x1873946287926656:12345-192.168.202.36@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787134906.953435:0:14477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14574:x1873946287926656:12345-192.168.202.36@tcp:900:lhsmtool_posix.0 Request processed in 109us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134906.953443:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:0.0:1787134906.955328:0:14498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14498:1873946312033280:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787134906.957135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134906.957249:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287926784 00000100:00100000:0.0:1787134906.957259:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287926784 00000100:00100000:0.0:1787134906.957317:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:0.0:1787134906.957327:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+29:14574:x1873946287926784:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787134906.957357:0:14467:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787134906.957748:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+29:14574:x1873946287926784:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 421us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134906.957757:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:2.0:1787134906.969962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134906.970053:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287926912 00000100:00100000:0.0:1787134906.970063:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287926912 00000100:00100000:2.0:1787134906.970147:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:2.0:1787134906.970177:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+29:14574:x1873946287926912:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787134906.970254:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.970384:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971011:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971077:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971085:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971091:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971134:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971143:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971150:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134906.971578:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787134906.971585:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787134906.971598:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971610:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971617:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971638:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971645:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa96000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134906.971649:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971658:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971672:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa59e99100) 00010000:00010000:2.0:1787134906.971675:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134906.971680:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971687:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96000/0x69932dacae90744b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.971703:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972510:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972524:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972530:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa97a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134906.972533:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972553:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972564:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98aa59e99300) 00010000:00010000:2.0:1787134906.972567:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134906.972570:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972578:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa97a00/0x69932dacae907452 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972597:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972603:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972608:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972614:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa4d6a9200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134906.972616:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972621:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972628:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa531ac500) 00010000:00010000:2.0:1787134906.972631:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134906.972634:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134906.972650:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9200/0x69932dacae907459 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134906.972857:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+29:14574:x1873946287926912:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 2695us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134906.972867:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:1.0:1787134906.977636:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134906.977723:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287927168 00000100:00100000:3.0:1787134906.977735:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287927168 00000100:00100000:3.0:1787134906.977798:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:3.0:1787134906.977808:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+29:14574:x1873946287927168:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134906.977829:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134906.977849:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae907460 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707f7 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.977945:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.977959:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.977988:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787134906.978001:0:16342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787134906.978128:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.978137:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.978143:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.978150:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ba00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134906.978154:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.978555:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.978570:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa531ac500) 00010000:00010000:3.0:1787134906.978572:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787134906.978577:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.978583:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ba00/0x69932dacae907467 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.978631:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae907460 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707f7 expref: 31 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.978654:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98aa59e99100) 00010000:00010000:3.0:1787134906.978657:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787134906.978661:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae907460 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707f7 expref: 31 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134906.978670:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7b400, rc 0) 00000100:00100000:3.0:1787134906.978736:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14574:x1873946287927168:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 929us (1108us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1787134906.978744:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:1.0:1787134906.985381:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134906.985644:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287927296 00000100:00100000:2.0:1787134906.985655:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287927296 00000100:00100000:2.0:1787134906.985720:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:2.0:1787134906.985732:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14574:x1873946287927296:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787134906.985770:0:14468:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787134906.985903:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14574:x1873946287927296:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 173us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134906.985911:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:2.0:1787134907.001497:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134907.002495:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287927552 00000100:00100000:3.0:1787134907.002510:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287927552 00000100:00100000:3.0:1787134907.002583:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:3.0:1787134907.002594:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+30:14574:x1873946287927552:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134907.002615:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134907.002637:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae907475 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac90707fe expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787134907.004225:0:16342:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787134907.004238:0:16342:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787134907.004297:0:16342:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787134907.004635:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9400/0x69932dacae90747c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.004653:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9400/0x69932dacae90747c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.004667:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9400/0x69932dacae90747c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.004732:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b400/0x69932dacae907475 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707fe expref: 33 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.004762:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9400/0x69932dacae90747c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707fe expref: 32 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.004772:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa59e99300) 00010000:00010000:2.0:1787134907.004775:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787134907.004779:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa4d6a9400, rc 0) 00000100:00100000:2.0:1787134907.004865:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+32:14574:x1873946287927552:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 2273us (3378us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787134907.004874:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:1.0:1787134907.012591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.012671:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287927808 00000100:00100000:2.0:1787134907.012682:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287927808 00000100:00100000:2.0:1787134907.012758:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:2.0:1787134907.012769:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+32:14574:x1873946287927808:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787134907.012829:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787134907.012857:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9400/0x69932dacae90747c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707fe expref: 32 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.012877:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa59e99300) 00010000:00010000:2.0:1787134907.012888:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787134907.012911:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.012923:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.012933:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.012961:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.012969:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.012975:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013068:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013076:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013083:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013089:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa4d6a8e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134907.013094:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013102:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013110:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:2.0:1787134907.013113:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134907.013117:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013123:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae90748a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013140:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013146:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013152:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013379:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa4d6a8400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134907.013382:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013389:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013407:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x40ef4db9 (ffff98aa59e99200) 00010000:00010000:2.0:1787134907.013410:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787134907.013414:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.013430:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae907491 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x40ef4db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134907.013512:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+31:14574:x1873946287927808:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 744us (931us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787134907.013519:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:3.0:1787134907.017911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134907.017968:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287927936 00000100:00100000:0.0:1787134907.017978:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287927936 00000100:00100000:0.0:1787134907.018050:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:0.0:1787134907.018061:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+31:14574:x1873946287927936:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134907.018084:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134907.018106:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670800/0x69932dacae907498 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070805 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.018140:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670a00/0x69932dacae90749f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.018153:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670a00/0x69932dacae90749f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.018210:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670a00/0x69932dacae90749f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.018301:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670800/0x69932dacae907498 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070805 expref: 33 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.018319:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670a00/0x69932dacae90749f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070805 expref: 32 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.018328:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa531aca00) 00010000:00010000:0.0:1787134907.018331:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787134907.018334:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa41670a00, rc 0) 00000100:00100000:0.0:1787134907.018385:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+32:14574:x1873946287927936:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 326us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134907.018393:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:3.0:1787134907.026366:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.026510:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287928192 00000100:00100000:2.0:1787134907.026522:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287928192 00000100:00100000:2.0:1787134907.026584:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:2.0:1787134907.026609:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+32:14574:x1873946287928192:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787134907.026693:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.026709:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.026720:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787134907.027225:0:14468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787134907.027237:0:14468:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 522994077526ns, next at 523994075145ns, rc = 0 00000004:00010000:2.0:1787134907.027333:0:14468:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000c05fa760 reply state 0000000001833aa5 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134907.027343:0:14468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787134907.027715:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+34:14574:x1873946287928192:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 1106us (1357us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1787134907.027724:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00010000:00010000:0.0:1787134907.030634:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.030652:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.030660:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.030667:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa4d6a8400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134907.030672:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.030679:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.030713:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa531aca00) 00010000:00010000:0.0:1787134907.030716:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787134907.030721:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.030727:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8400/0x69932dacae9074a6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134907.032072:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.032996:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287928320 00000100:00100000:2.0:1787134907.033029:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287928320 00000100:00100000:2.0:1787134907.033119:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:2.0:1787134907.033135:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+33:14574:x1873946287928320:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134907.033210:0:16342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134907.033232:0:16342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907080c expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.033292:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907080c expref: 34 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.033357:0:16342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907080c expref: 34 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.033391:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa531aca00) 00010000:00010000:2.0:1787134907.033395:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134907.033398:0:16342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa4d6a8e00, rc 0) 00000100:00100000:2.0:1787134907.034551:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+34:14574:x1873946287928320:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 358us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134907.034560:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:1.0:1787134907.037596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134907.037833:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287928448 00000100:00100000:3.0:1787134907.037843:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287928448 00000100:00100000:3.0:1787134907.037916:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787134907.037927:0:15153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2351:x1873946287928448:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787134907.038479:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134907.039086:0:15153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2351:x1873946287928448:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 1158us (1496us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787134907.039107:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787134907.050365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.050818:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287928704 00000100:00100000:2.0:1787134907.050831:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287928704 00000100:00100000:2.0:1787134907.050894:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:2.0:1787134907.050904:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+34:14574:x1873946287928704:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787134907.051155:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+35:14574:x1873946287928704:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 251us (798us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787134907.051809:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:2.0:1787134907.054435:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134907.054689:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287928960 00000100:00100000:1.0:1787134907.054699:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287928960 00000100:00100000:1.0:1787134907.054769:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:1.0:1787134907.054780:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+35:14574:x1873946287928960:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787134907.054898:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+35:14574:x1873946287928960:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 120us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134907.054906:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:3.0:1787134907.059155:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134907.059300:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287929088 00000100:00100000:0.0:1787134907.059324:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287929088 00000100:00100000:0.0:1787134907.059398:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:0.0:1787134907.059409:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+35:14574:x1873946287929088:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787134907.059440:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787134907.059471:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670800/0x69932dacae9074b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070813 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.060042:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.060058:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.060071:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787134907.060113:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787134907.060135:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.060206:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670800/0x69932dacae9074b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070813 expref: 37 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.060235:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070813 expref: 36 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.060244:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa531aca00) 00010000:00010000:0.0:1787134907.060247:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787134907.060250:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa41671400, rc 0) 00000100:00100000:0.0:1787134907.061140:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+36:14574:x1873946287929088:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1726us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134907.061152:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:1.0:1787134907.067254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134907.067606:0:15637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287929216 00000100:00100000:3.0:1787134907.067617:0:15637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287929216 00000100:00100000:3.0:1787134907.067705:0:15637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:3.0:1787134907.067821:0:15637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2351:x1873946287929216:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787134907.067841:0:15637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787134907.067862:0:15637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907081a expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787134907.067891:0:15637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8583bb, blocks: 0x1 00010000:00010000:3.0:1787134907.067913:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1787134907.067917:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787134907.067927:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907081a expref: 7 pid: 15637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.067948:0:15637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907081a expref: 7 pid: 15637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.067962:0:15637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa7fa7ba00, rc 0) 00000100:00100000:3.0:1787134907.068035:0:15637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+7:2351:x1873946287929216:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 217us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134907.068041:0:15637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:2.0:1787134907.072802:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134907.073151:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287929472 00000100:00100000:3.0:1787134907.073284:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287929472 00000100:00100000:3.0:1787134907.073652:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:3.0:1787134907.073662:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+36:14574:x1873946287929472:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787134907.073768:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+36:14574:x1873946287929472:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 107us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134907.073776:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:1.0:1787134907.076931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.077014:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287929600 00000100:00100000:2.0:1787134907.077025:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287929600 00000100:00100000:2.0:1787134907.077079:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:2.0:1787134907.077088:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+36:14574:x1873946287929600:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787134907.126055:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.126093:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.126318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.126346:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.126375:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.126405:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287929856 00000100:00100000:2.0:1787134907.126414:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287929856 00000100:00100000:2.0:1787134907.126474:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287930112 00000100:00100000:2.0:1787134907.126478:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287930112 00000100:00100000:2.0:1787134907.126948:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287930240 00000100:00100000:2.0:1787134907.126952:0:15153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287930240 00000100:00100000:2.0:1787134907.126970:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:2.0:1787134907.126979:0:15153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2349:x1873946287929856:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134907.127624:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:3.0:1787134907.127636:0:15152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2349:x1873946287930112:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134907.127749:0:15152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2349:x1873946287930112:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 115us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134907.127757:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:3.0:1787134907.127780:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:3.0:1787134907.127787:0:15152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2349:x1873946287930240:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787134907.127813:0:15152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+5:2349:x1873946287930240:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 27us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134907.127819:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:2.0:1787134907.128966:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287929728 00000100:00100000:2.0:1787134907.128975:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287929728 00000100:00100000:2.0:1787134907.129015:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:2.0:1787134907.129023:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:2349:x1873946287929728:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134907.129063:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:deca4287-87b1-4d46-bf9c-d0ee99fafe78+13:2349:x1873946287929728:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 42us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134907.129070:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00080000:2.0:1787134907.129119:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787134907.129125:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787134907.129153:0:15153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+5:2349:x1873946287929856:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 2175us (3109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134907.129178:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:2.0:1787134907.129199:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287929984 00000100:00100000:2.0:1787134907.129203:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287929984 00000100:00080000:2.0:1787134907.129221:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787134907.129250:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:2.0:1787134907.129257:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+10:2349:x1873946287929984:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787134907.129301:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6ebf304-0507-46d5-8ad2-f99a8ccc1df5+10:2349:x1873946287929984:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 45us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134907.129308:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000001:00080000:0.0:1787134907.165851:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:0.0:1787134907.165866:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1787134907.165874:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:0.0:1787134907.165889:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1787134907.165914:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787134907.165951:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000100:00100000:3.0:1787134907.165967:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+20:14574:x1873946287929600:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 88874us (89038us total) trans 0 rc 0/0 00000001:00080000:0.0:1787134907.165978:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1787134907.165981:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:0.0:1787134907.166187:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7ae4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312033408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787134907.166248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134907.166617:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312033408 00000100:00100000:3.0:1787134907.166625:0:15152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312033408 00000100:00100000:3.0:1787134907.166669:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787134907.166676:0:15152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873946312033408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787134907.166815:0:15152:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787134907.166827:0:15152:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787134907.166828:0:15152:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787134907.166830:0:15152:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787134907 -> 1787134907 00002000:00010000:3.0:1787134907.166832:0:15152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787134907.166912:0:15152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1873946312033408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (665us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787134907.166917:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787134907.169851:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134907.175107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134907.175236:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287930368 00000100:00100000:1.0:1787134907.175260:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287930368 00000100:00100000:1.0:1787134907.175326:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:1.0:1787134907.175336:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+7:2351:x1873946287930368:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787134907.175474:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+7:2351:x1873946287930368:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 138us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134907.175494:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:1.0:1787134907.183012:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134907.183285:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287930624 00000100:00100000:3.0:1787134907.183295:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287930624 00000100:00100000:3.0:1787134907.183378:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:3.0:1787134907.183390:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+13:14574:x1873946287930624:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787134907.183461:0:14467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787134907.183504:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070813 expref: 13 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.183527:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa531aca00) 00010000:00010000:3.0:1787134907.183532:0:14467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787134907.183562:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.183576:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.183586:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787134907.183805:0:14467:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000000b7aef6 reply state 00000000d21edd54 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134907.183832:0:14467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787134907.183944:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+14:14574:x1873946287930624:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 555us (943us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787134907.183951:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:2.0:1787134907.192131:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000004:00080000:0.0:1787134907.192650:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98aa7ae4ad80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787134907.192662:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7ae4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1873946312033408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787134907.192914:0:15637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287930752 00000100:00100000:2.0:1787134907.192922:0:15637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287930752 00000100:00100000:2.0:1787134907.192992:0:15637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787134907.193003:0:15637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7ae4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+7:14574:x1873946287930752:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787134907.193023:0:15637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134907.193042:0:15637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070821 expref: -99 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.193076:0:15637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907081a expref: 8 pid: 15637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.193086:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134907.193092:0:15637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787134907.193098:0:15637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 8 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.193139:0:15637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907081a expref: 8 pid: 15637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.193155:0:15637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907081a expref: 8 pid: 15637 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134907.193210:0:15637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15637:1873946312033536:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134907.193304:0:15637:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8600 going to sleep for 11 seconds 00010000:00010000:3.0:1787134907.193973:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.193985:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.193994:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.194000:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ae00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134907.194005:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.194012:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.194030:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa531aca00) 00010000:00010000:3.0:1787134907.194033:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134907.194037:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.194042:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae9074c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134907.204266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134907.204774:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287930880 00000100:00100000:0.0:1787134907.204784:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287930880 00010000:00010000:0.0:1787134907.204838:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907081a expref: 9 pid: 15637 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134907.204887:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787134907.204913:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+9:2351:x1873946287930880:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787134907.204929:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787134907.204953:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907081a expref: 9 pid: 15637 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.204967:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907081a expref: 9 pid: 15637 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.205000:0:14452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134907.205005:0:14452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134907.205012:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 9 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.205023:0:14452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 9 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.205062:0:14452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 9 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134907.205076:0:14452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14452:1873946312033664:192.168.202.36@tcp:105: 00000100:00100000:0.0:1787134907.205198:0:14452:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81bd3600 going to sleep for 11 seconds 00010000:00010000:2.0:1787134907.206053:0:15637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028fbf96c/0x69932dacae9074c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907081a expref: 9 pid: 15637 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134907.206075:0:15637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15637:1873946312033536:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787134907.206120:0:15637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 8 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.206134:0:15637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa4d6a8600, rc 0) 00000100:00100000:2.0:1787134907.206217:0:15637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7ae4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+8:14574:x1873946287930752:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 13215us (14099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134907.206225:0:15637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:0.0:1787134907.211282:0:14452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14452:1873946312033664:192.168.202.36@tcp:105: 00010000:00010000:0.0:1787134907.211324:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787134907.211392:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+7:2351:x1873946287930880:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 6482us (7144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787134907.211435:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:3.0:1787134907.218119:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134907.218255:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287931008 00000100:00100000:1.0:1787134907.218266:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287931008 00000100:00100000:1.0:1787134907.218325:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:1.0:1787134907.218336:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+7:2352:x1873946287931008:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787134907.218565:0:15150:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787134907.218569:0:15150:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787134907 00002000:00010000:1.0:1787134907.218571:0:15150:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787134905 00002000:00010000:1.0:1787134907.218574:0:15150:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787134907 -> 1787134907 00002000:00010000:1.0:1787134907.218576:0:15150:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787134907.218638:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+8:2352:x1873946287931008:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 304us (539us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787134907.218647:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:3.0:1787134907.236318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134907.236609:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287931136 00000100:00100000:0.0:1787134907.236622:0:15152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287931136 00000100:00100000:0.0:1787134907.236694:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:0.0:1787134907.236706:0:15152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+8:2349:x1873946287931136:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787134907.236753:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.236775:0:15152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 8 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.236785:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787134907.236790:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787134907.236795:0:15152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.236829:0:15152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 8 pid: 15637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.236844:0:15152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 8 pid: 15637 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134907.236860:0:15152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15152:1873946312033792:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787134907.236961:0:15152:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81bd3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787134907.244081:0:15152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15152:1873946312033792:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134907.244153:0:15152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134907.245968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134907.246223:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287931264 00000100:00100000:1.0:1787134907.246233:0:14453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287931264 00010000:00010000:1.0:1787134907.246274:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 9 pid: 15637 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134907.246325:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:1.0:1787134907.246348:0:14453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+9:2351:x1873946287931264:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134907.246377:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134907.246403:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 9 pid: 15637 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.246427:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 9 pid: 15637 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.246453:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004af4edd5/0x69932dacae9074d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xd233841ac9070821 expref: 9 pid: 15637 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.246473:0:14453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134907.246478:0:14453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787134907.246553:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.246564:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.246597:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134907.246671:0:14453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+8:2351:x1873946287931264:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 324us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134907.246680:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00010000:00010000:3.0:1787134907.246924:0:15152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.246935:0:15152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.246963:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.246973:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.246981:0:15152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.246989:0:15152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa41671800 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134907.246994:0:15152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.247005:0:15152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.247017:0:15152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.247025:0:15152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000282ee5ee/0x69932dacae9074d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134907.247104:0:15152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+7:2349:x1873946287931136:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 10398us (10810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134907.247121:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:3.0:1787134907.249732:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.249882:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287931520 00000100:00100000:2.0:1787134907.249895:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287931520 00000100:00100000:2.0:1787134907.249971:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:2.0:1787134907.249986:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+13:14574:x1873946287931520:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787134907.250094:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.250214:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.250229:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.250759:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.250774:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907080c expref: 14 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.250782:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.250816:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907080c expref: 14 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.250831:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907080c expref: 14 pid: 16342 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134907.250849:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14466:1873946312033920:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787134907.250972:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787134907.256072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134907.258063:0:16582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287931648 00000100:00100000:1.0:1787134907.258079:0:16582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287931648 00010000:00010000:1.0:1787134907.258142:0:16582:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907080c expref: 15 pid: 16342 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134907.258224:0:16582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:1.0:1787134907.258236:0:16582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+15:2351:x1873946287931648:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787134907.258253:0:16582:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787134907.258260:0:16582:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907080c expref: 15 pid: 16342 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.258274:0:16582:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907080c expref: 15 pid: 16342 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.258312:0:16582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa531aca00) 00010000:00010000:1.0:1787134907.258317:0:16582:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.258328:0:16582:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.258336:0:16582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.258360:0:16582:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787134907.258650:0:16582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+15:2351:x1873946287931648:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 416us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134907.258659:0:16582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00010000:00010000:0.0:1787134907.266555:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8e00/0x69932dacae9074ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xd233841ac907080c expref: 14 pid: 16342 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787134907.266585:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14466:1873946312033920:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787134907.266614:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.266626:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.266633:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787134907.266830:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787134907.266977:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1787134907.267025:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1787134907.268641:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa743a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14466:1873946312034048:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787134907.268770:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787134907.268821:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa81bd3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787134907.269141:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312034048 00000100:00100000:2.0:1787134907.269151:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312034048 00000100:00100000:2.0:1787134907.269229:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787134907.269239:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14466:x1873946312034048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787134907.269352:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14466:x1873946312034048:12345-0@lo:1000:mdt00_000.0 Request processed in 113us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787134907.269359:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787134907.269681:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa743a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14466:1873946312034048:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787134907.270762:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1787134907.270857:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd57800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14466:1873946312034176:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787134907.270908:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134907.270940:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa457afe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787134907.270967:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312034176 00000100:00100000:3.0:1787134907.270973:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312034176 00000100:00100000:3.0:1787134907.271007:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134907.271014:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14466:x1873946312034176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787134907.278871:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14466:x1873946312034176:12345-0@lo:1000:mdt00_000.0 Request processed in 7841us (7946us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787134907.278907:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787134907.291754:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd57800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14466:1873946312034176:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787134907.291944:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.291957:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.291964:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.291971:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa4d6a9e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134907.291976:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.291985:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292006:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa531aca00) 00010000:00010000:2.0:1787134907.292009:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134907.292015:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292021:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9e00/0x69932dacae9074e5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292070:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292077:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292083:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292123:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa41670c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1787134907.292127:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292133:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292141:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa531ac500) 00010000:00010000:2.0:1787134907.292144:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787134907.292151:0:14466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907444 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707f0 expref: 17 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292204:0:14466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907444 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707f0 expref: 17 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292215:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907444 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707f0 expref: 17 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.292280:0:14466:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa96600/0x69932dacae907444 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac90707f0 expref: 17 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787134907.292296:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa81e4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14466:1873946312034304:192.168.202.36@tcp:105: 00000100:00100000:2.0:1787134907.292595:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9437b8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787134907.298953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134907.299090:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa81e4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14466:1873946312034304:192.168.202.36@tcp:105: 00010000:00010000:0.0:1787134907.299152:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299194:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41670c00/0x69932dacae90743d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299240:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299252:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299261:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299268:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299272:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299276:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299280:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa41671800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134907.299282:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299287:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299296:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa531ac500) 00010000:00010000:0.0:1787134907.299298:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787134907.299300:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299303:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671800/0x69932dacae9074ec lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299319:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299325:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299330:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299335:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa4d6a9000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1787134907.299338:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299344:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299352:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa531ac500) 00010000:00010000:0.0:1787134907.299355:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787134907.299358:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.299364:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a9000/0x69932dacae9074de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787134907.299812:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287931776 00000100:00100000:1.0:1787134907.299821:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287931776 00000100:00100000:1.0:1787134907.299884:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787134907.299893:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+18:14572:x1873946287931776:12345-192.168.202.36@tcp:49:bash.0 00000040:00080000:2.0:1787134907.300183:0:14498:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787134907.300189:0:14498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787134907.300208:0:14498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787134907.300218:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787134907.300297:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+18:14574:x1873946287931520:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 50314us (50579us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787134907.300310:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00000020:00080000:0.0:1787134907.300316:0:14466:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787134907.306740:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8960d563-8403-4d98-8d5e-3187c5fedce5+17:14572:x1873946287931776:12345-192.168.202.36@tcp:49:bash.0 Request processed in 6832us (7783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134907.306757:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787134907.317791:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.319014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134907.319101:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287932160 00000100:00100000:0.0:1787134907.319125:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287932160 00000100:00100000:0.0:1787134907.319240:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787134907.319251:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+17:14574:x1873946287932160:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787134907.319989:0:14469:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787134907.320097:0:14469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1787134907.320147:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.320209:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.320221:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.320230:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.320237:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.320244:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787134907.320259:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787134907.320377:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+19:14574:x1873946287932160:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1125us (1368us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1787134907.320387:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000020:00080000:0.0:1787134907.320392:0:14469:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787134907.320776:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787134907.320786:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.320794:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa41671400 already unused, calling callback (ffffffffc1502390) 00010000:00010000:3.0:1787134907.320798:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.320807:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.320838:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98aa531aca00) 00010000:00010000:3.0:1787134907.320841:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787134907.320846:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.320852:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa41671400/0x69932dacae9074f3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.320868:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134907.320870:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787134907.320871:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787134907.330360:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287931904 00000100:00100000:1.0:1787134907.330380:0:15150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287931904 00000100:00100000:1.0:1787134907.330464:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:1.0:1787134907.330476:0:15150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa819e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+7:14572:x1873946287931904:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787134907.330508:0:15150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787134907.330532:0:15150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc79cd46/0x69932dacae9074fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac9070828 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787134907.330561:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8583bb, atime: 0x6a8583b9, ctime: 0x6a8583bb, blocks: 0x1 00010000:00010000:1.0:1787134907.330582:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1787134907.330587:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787134907.330598:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc79cd46/0x69932dacae9074fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070828 expref: 8 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.330614:0:15150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc79cd46/0x69932dacae9074fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac9070828 expref: 8 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787134907.330626:0:15150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa6fbe6c00, rc 0) 00000100:00100000:1.0:1787134907.330707:0:15150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa819e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+8:14572:x1873946287931904:12345-192.168.202.36@tcp:101:bash.0 Request processed in 233us (12928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134907.330714:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:2.0:1787134907.345331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134907.345469:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287932416 00000100:00100000:0.0:1787134907.345490:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287932416 00000100:00100000:0.0:1787134907.345550:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787134907.345560:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+19:14572:x1873946287932416:12345-192.168.202.36@tcp:35:bash.0 00000001:00080000:0.0:1787134907.345859:0:14469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:0.0:1787134907.345992:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+21:14572:x1873946287932416:12345-192.168.202.36@tcp:35:bash.0 Request processed in 432us (671us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1787134907.345998:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000020:00080000:0.0:1787134907.346002:0:14469:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787134907.521780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787134907.521934:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287932672 00000100:00100000:2.0:1787134907.521947:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287932672 00000100:00100000:2.0:1787134907.522011:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:2.0:1787134907.522022:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+21:14584:x1873946287932672:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787134907.522046:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787134907.522067:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8000/0x69932dacae907501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd233841ac907082f expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787134907.522389:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787134907.522581:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8000/0x69932dacae907501 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907082f expref: 23 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.522597:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98aa531ac700) 00010000:00010000:2.0:1787134907.522600:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787134907.522605:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa4d6a8000/0x69932dacae907501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xd233841ac907082f expref: 23 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787134907.522620:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa4d6a8000, rc 0) 00000100:00100000:2.0:1787134907.522696:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8960d563-8403-4d98-8d5e-3187c5fedce5+22:14584:x1873946287932672:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 675us (926us total) trans 8589934633 rc 301/301 00000100:00100000:2.0:1787134907.522704:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:0.0:1787134907.527442:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787134907.527583:0:16342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287932800 00000100:00100000:3.0:1787134907.527596:0:16342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287932800 00000100:00100000:3.0:1787134907.527676:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:3.0:1787134907.527686:0:16342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+22:14584:x1873946287932800:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:3.0:1787134907.527772:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.527789:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.527801:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.527817:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.527824:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.527830:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528152:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528203:0:16342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528210:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787134907.528251:0:16342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528263:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528271:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528277:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528283:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7a400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134907.528287:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528294:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528306:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98aa50adec00) 00010000:00010000:3.0:1787134907.528309:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134907.528313:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528325:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7a400/0x69932dacae90750f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528336:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528342:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528347:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528351:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7b800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134907.528354:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528360:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528367:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98aa59fa6300) 00010000:00010000:3.0:1787134907.528370:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134907.528372:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528378:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7b800/0x69932dacae907516 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528391:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528537:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528549:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528555:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa7fa7ae00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1787134907.528558:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528565:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528573:0:16342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98aa531ac500) 00010000:00010000:3.0:1787134907.528576:0:16342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787134907.528578:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787134907.528583:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa7fa7ae00/0x69932dacae90751d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787134907.528671:0:16342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+22:14584:x1873946287932800:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 985us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134907.528681:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:1.0:1787134907.531794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787134907.531858:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287933056 00000100:00100000:0.0:1787134907.531870:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287933056 00000100:00100000:0.0:1787134907.531933:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:0.0:1787134907.531945:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+22:14584:x1873946287933056:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787134907.532689:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+23:14584:x1873946287933056:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 743us (902us total) trans 8589934634 rc 0/0 00000100:00100000:0.0:1787134907.532698:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00010000:00010000:0.0:1787134907.712344:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787134908.737801:0:15634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787134909.314945:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312034432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787134909.315026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134909.315145:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312034432 00000100:00100000:1.0:1787134909.315179:0:15154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312034432 00000100:00100000:1.0:1787134909.315260:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787134909.315270:0:15154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312034432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787134909.315308:0:15154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787134909.320739:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787134909.323248:0:15154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873946312034432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7969us (8210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134909.323264:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787134909.324672:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312034432:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787134909.347854:0:16733:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1787134909.760428:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787134909.824359:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787134909.824403:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312034560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787134909.824481:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787134909.824581:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312034560 00000100:00100000:1.0:1787134909.824600:0:15155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312034560 00000100:00100000:1.0:1787134909.824748:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787134909.824762:0:15155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312034560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787134909.824797:0:15155:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787134909.824846:0:15155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa743a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873946312034560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00080000:0.0:1787134909.824894:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787134909.824902:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa7f66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312034688:0@lo:400:kworker.0 00000100:00100000:0.0:1787134909.824906:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312034816:0@lo:400:kworker.0 00000100:00100000:0.0:1787134909.824932:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134909.824934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134909.824964:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312035072:0@lo:400:kworker.0 00000100:00100000:3.0:1787134909.824985:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134909.824999:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787134909.825005:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98aa6fd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312034944:0@lo:400:kworker.0 00000100:00100000:3.0:1787134909.825051:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787134909.825074:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312034816 00000100:00100000:3.0:1787134909.825078:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312034816 00000100:00100000:3.0:1787134909.825103:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312035072 00000100:00100000:3.0:1787134909.825106:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312035072 00000100:00100000:3.0:1787134909.825142:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312034944 00000100:00100000:3.0:1787134909.825146:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312034944 00000100:00100000:3.0:1787134909.825205:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787134909.825212:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312034816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787134909.825237:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1873946312034560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787134909.825247:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873946312034816:12345-0@lo:400:kworker.0 Request processed in 36us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134909.825280:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787134909.825297:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787134909.825319:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312035072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134909.825364:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873946312035072:12345-0@lo:400:kworker.0 Request processed in 62us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134909.825376:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787134909.825386:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787134909.825405:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa6fd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312034944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134909.825430:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa6fd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873946312034944:12345-0@lo:400:kworker.0 Request processed in 39us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134909.825444:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787134909.825479:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787134909.825497:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873946312034816:0@lo:400:kworker.0 00000100:00100000:3.0:1787134909.825524:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1873946312034944:0@lo:400:kworker.0 00000100:00100000:3.0:1787134909.825532:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa6fd94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1873946312035072:0@lo:400:kworker.0 00000100:00100000:3.0:1787134909.825606:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946312034688 00000100:00100000:3.0:1787134909.825610:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946312034688 00000100:00100000:3.0:1787134909.825790:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787134909.825800:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa81d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+19:3307:x1873946312034688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787134909.825846:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa81d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:787f8101-2629-402b-af83-ff6c365f26f7+19:3307:x1873946312034688:12345-0@lo:400:kworker.0 Request processed in 48us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787134909.825852:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787134909.825904:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98aa7f66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:787f8101-2629-402b-af83-ff6c365f26f7:3307:1873946312034688:0@lo:400:kworker.0 00000100:00100000:1.0:1787134909.843661:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000001:00080000:3.0:1787134909.885021:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:3.0:1787134909.885043:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000040:00080000:0.0:1787134910.400536:0:14498:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787134910.400570:0:14498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787134910.400604:0:14498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787134910.400611:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787134910.716429:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134910.716476:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787134910.716527:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287933184 00000100:00100000:1.0:1787134910.716537:0:15156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287933184 00002000:00100000:1.0:1787134910.716603:0:15156:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff98aa7f779c00 x1873946287933184/t0(0) o4->8960d563-8403-4d98-8d5e-3187c5fedce5@192.168.202.36@tcp:91/0 lens 504/0 e 0 to 0 dl 1787134921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787134910.716615:0:15156:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa7f779c00 with x1873946287933184 ext(0->8) 00002000:00010000:1.0:1787134910.716623:0:15156:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa7f779c00 00000100:00100000:1.0:1787134910.716651:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787134910.716663:0:15156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2350:x1873946287933184:12345-192.168.202.36@tcp:4:bash.0 00000100:00100000:1.0:1787134910.717353:0:15156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8960d563-8403-4d98-8d5e-3187c5fedce5+8:2350:x1873946287933184:12345-192.168.202.36@tcp:4:bash.0 Request processed in 690us (936us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787134910.717368:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00002000:00100000:1.0:1787134910.717377:0:15156:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff98aa7f779c00 x1873946287933184/t8589934598(0) o4->8960d563-8403-4d98-8d5e-3187c5fedce5@192.168.202.36@tcp:91/0 lens 504/448 e 0 to 0 dl 1787134921 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787134910.717396:0:15156:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff98aa7f779c00 with x1873946287933184 ext(0->8) 00002000:00010000:1.0:1787134910.717400:0:15156:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98aa7f779c00 00000100:00100000:1.0:1787134910.717431:0:15637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873946287933312 00000100:00100000:1.0:1787134910.717435:0:15637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873946287933312 00000100:00100000:1.0:1787134910.717463:0:15637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:1.0:1787134910.717470:0:15637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa7f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+8:2350:x1873946287933312:12345-192.168.202.36@tcp:16:kworker.0 00000100:00080000:3.0:1787134910.719655:0:14462:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787134910.792538:0:14455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787134910.811650:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:1.0:1787134910.815826:0:15637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa7f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8960d563-8403-4d98-8d5e-3187c5fedce5+6:2350:x1873946287933312:12345-192.168.202.36@tcp:16:kworker.0 Request processed in 98342us (99334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787134910.815843:0:15637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 Debug log: 30513 lines, 30513 kept, 0 dropped, 0 bad.